Developed a web-crawler using multi-thread operation to gather all the links from any particular website.
main.py to run the code
To change the site name open main.py and change HOMEPAGE variable to the required site.
-
Notifications
You must be signed in to change notification settings - Fork 0
LuffyAnshul/webCrawler
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Developed a web-crawler using multi-thread operation to gather all the links from any particular website.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published