Skip to content

PokePython is a web scraping project that uses Selenium

License

Notifications You must be signed in to change notification settings

AlexisLoya/PokePython

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

banner

PokePython

Description

PokePython is a web scraping project that uses Selenium to "catch 'em all" — Pokémons, that is. This project scrapes Pokémon and their variant information from The Silph Road and stores it in an SQLite database for further analysis and usage.

Libraries Used

  • Selenium: For web scraping.
  • SQLite: For data storage.
  • Logging: For logging activity and errors.
  • re (Regex): For pattern matching in strings.
  • time: For controlling the time between requests.
  • os: For filesystem manipulation.

Installation Guide

  1. Create a Virtual Environment (venv)

    python3 -m venv .venv
  2. Activate the Virtual Environment

    • Windows
      .venv\Scripts\activate
    • macOS and Linux
      source .venv/bin/activate
  3. Install Dependencies from requirements.txt

    pip install -r requirements.txt
  4. Download chromedriver.exe File

    • Visit the ChromeDriver download page.
    • Download the version that matches your Chrome browser version.
    • Extract the chromedriver.exe file and place it in the chrome folder within the project directory.

Usage

To start catching all the Pokémons, simply run the main.py script.

python main.py

This will initiate the web scraping process and store the data in the SQLite database pokedex.db and as HTML files within the pokedex folder.

License

This project is under the MIT license. See the LICENSE file for more details.

About

PokePython is a web scraping project that uses Selenium

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages