-
Notifications
You must be signed in to change notification settings - Fork 0
Web Crawler is a Node.js application that allows you to crawl web pages, save them locally, and extract hyperlinks from the page body. It provides a simple command-line interface where you can enter the starting URL and specify the maximum number of crawls. The crawler follows the hyperlinks recursively, saves the web pages in a specified directory
ssharmapavitra/webcrawler
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
About
Web Crawler is a Node.js application that allows you to crawl web pages, save them locally, and extract hyperlinks from the page body. It provides a simple command-line interface where you can enter the starting URL and specify the maximum number of crawls. The crawler follows the hyperlinks recursively, saves the web pages in a specified directory
Topics
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published