-
Notifications
You must be signed in to change notification settings - Fork 477
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
能否增加一个爬虫入口(url列表) 像awvs一样,因为有一些页面爬虫爬不到? #31
Comments
爬虫入口(url列表) 是指输入列表?还是指什么呢 |
是的,输入列表,如果能增加输入列表,会引导爬虫去抓取一些爬虫本身发现不了的页面,另外crawlergo有一些bug,没法判断404页面,导致这些404页面也会一并输出。。。。 |
目前我的方法是拼接, 比如 http://www.A.com, 已知了两个路径: /path_a,/path_b 有两个问题:
当然后期能有参数支持多路径作为入口最好不过. |
vim /home/user/fuzz_dir.txt /path_a
/path_b 可以通过 crawlergo -c chrome --fuzz-path-dict /home/user/fuzz_dir.txt http://www.A.com/ 但这个方式会覆盖掉内置的 |
能否增加一个爬虫入口(url列表) 像awvs一样,因为有一些页面爬虫爬不到?
The text was updated successfully, but these errors were encountered: