PokePython is a web scraping project that uses Selenium to "catch 'em all" — Pokémons, that is. This project scrapes Pokémon and their variant information from The Silph Road and stores it in an SQLite database for further analysis and usage.
- Selenium: For web scraping.
- SQLite: For data storage.
- Logging: For logging activity and errors.
- re (Regex): For pattern matching in strings.
- time: For controlling the time between requests.
- os: For filesystem manipulation.
-
Create a Virtual Environment (venv)
python3 -m venv .venv
-
Activate the Virtual Environment
- Windows
.venv\Scripts\activate
- macOS and Linux
source .venv/bin/activate
- Windows
-
Install Dependencies from
requirements.txt
pip install -r requirements.txt
-
Download
chromedriver.exe
File- Visit the ChromeDriver download page.
- Download the version that matches your Chrome browser version.
- Extract the
chromedriver.exe
file and place it in thechrome
folder within the project directory.
To start catching all the Pokémons, simply run the main.py
script.
python main.py
This will initiate the web scraping process and store the data in the SQLite database pokedex.db and as HTML files within the pokedex folder.
This project is under the MIT license. See the LICENSE file for more details.