Skip to content

Latest commit

 

History

History
134 lines (103 loc) · 4.97 KB

README.md

File metadata and controls

134 lines (103 loc) · 4.97 KB
Raw

Contributors Forks Stargazers Issues MIT License LinkedIn

NBA Topshot Data Scraper

Node script that will use Selenium to scrape card information from NBA Topshot including card names, rarity, and lowest cost at the moment.
Explore the docs »

View Demo · Report Bug · Request Feature

Table of Contents
  1. About The Project
  2. Getting Started
  3. Contributing
  4. License
  5. Contact

About The Project

Node script that will use Selenium to scrape card information from NBA Topshot including card names, rarity, and lowest cost at the moment. This project is a fun way to keep track of the value of NBA moments from NBA Topshot. It relies on the marketplace being available, and the script basically scans all the items that is on the marketplace using selenium to do an infinite scroll + capturing all the data once infinite scroll is completed. At the moment, the script should not take more than 1 hour to run. Optimizations are always welcome.

Data is scraped once per day and updated onto this repo. This data can be found in the data folder and follows the naming convention: topshot_data_${date in mmddyyyy format}.

Built With

Getting Started

To get a local copy up and running follow these simple steps.

Prerequisites

This is an example of how to list things you need to use the software and how to install them.

  • npm 
    npm install npm@latest -g

Installation

  1. Clone the repo 
    git clone https://github.com/kennymkchan/nba-topshot-scraper
  2. Install NPM packages 
    npm install
  3. Run the script to start scraping 
    node index.js

Contributing

Contributions are what make the open source community such an amazing place to be learn, inspire, and create. Any contributions you make are greatly appreciated.

  1. Fork the Project
  2. Create your Feature Branch (git checkout -b feature/AmazingFeature)
  3. Commit your Changes (git commit -m 'Add some AmazingFeature')
  4. Push to the Branch (git push origin feature/AmazingFeature)
  5. Open a Pull Request

License

Distributed under the MIT License. See LICENSE for more information.

Contact

Kenny Chan - @github

Project Link: https://github.com/kennymkchan/nba-topshot-scraper