Skip to content

This is a script to scrape a test E-commerce site using Selenium-Python, Pandas-Python, and Tqdm.

Notifications You must be signed in to change notification settings

MagedMohamedTurk/Web-Scraping-Test-Sites

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 

Repository files navigation

Web-Scraping-Test-Sites

Description

Selenium-Python was used in this project to scrape data from https://webscraper.io/
The 'Test Sites' tab of the site resources lets you practice your scraping skills in a legal and safe way.
This project scrapes the 'https://webscraper.io/test-sites/e-commerce/static'
Here, the challenge was to handle pagination links when scraping all products.

Technique

In this project, I tried to present a proper approach to the scraping problem. Using predefined functions and the Tqdm package to track time is extremely valuable in your professional work.

Releases

No releases published

Packages

No packages published

Languages