Skip to content

ramsy0dev/proxycrawler

proxycrawler

GitHub commits since latest release (by SemVer including pre-releases) GitHub issues GitHub GitHub all releases GitHub code size in bytes

Table of content

What is proxycrawler?

proxycrawler is, as the name suggests, a proxy crawler and validator. proxycrawler scrapes services (as of v0.2.0, it supports only 2 services) that offer free proxies, either displayed in a table so you can then go through the hassle of trying to copy each one of them and validate them, or by directly sending out requests to the API that these services use (like Geonode.com).

What services does it scrap from?

As of v0.2.0 proxycrawler usilizes two services:

Installation

  • Prerequisites

    • Python3.10+
    • poetry
  • Install manually

To install manually you will need poetry in order to build from source after you clone the repo:

git clone https://github.com/ramsy0dev/proxycrawler
cd proxycrawler
poetry build
pip install dist/proxycrawler-*.tar.gz

Usage

To see how to use proxycrawler and get a basic guide on how to get started. Please checkout the wiki

Contributing

All contributations are acceptable.

License

GPL-3.0