Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

抓取太快被封停 #100

Open
ZhangSanMo opened this issue Apr 19, 2017 · 1 comment
Open

抓取太快被封停 #100

ZhangSanMo opened this issue Apr 19, 2017 · 1 comment

Comments

@ZhangSanMo
Copy link

ZhangSanMo commented Apr 19, 2017 •
edited
Loading

最近知乎搞了个反爬虫，抓取速度过快就会这样
image

不过我稍微改了一下程序，加了个3s的延时，能够抓取600+个回答，不过还是被封了。。。

不过主要问题不是这个

问题是能不能设置下载answer个数啊，因为并不是700+的回答我都需要，我 可能只需要100+ 而已
而且，一出错，所有数据都没了，还得重新下，很蛋疼啊

所以，能否加入

  1. 设置延时时间
  2. 设置只下载一部分答案

@YaoZeyuan
@TestSubject173
Copy link

TestSubject173 commented Feb 13, 2018 •
edited
Loading

@ZhangSanMo 可以告知修改延时的方法或者发给我修改好的文件吗……

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@ZhangSanMo @TestSubject173