Skip to content

bharathvaj-ganesan/pricing-page-scraper

Repository files navigation

This project scrapes pricing pages of SaaS products for you using AI.

Pricing Page Scraper

How it works

This project uses the OpenAI GPT-3.5 API (specifically more efficient and cheaper model gpt-3.5-turbo) and Vercel Edge functions with streaming. It fetches the pricing page content, sends it in a prompt to the GPT-3.5 API to scrape it via a Vercel Edge function, then streams the response back to the application.

Example Result

[
  {
    "plan_name": "FREE",
    "plan_amount": 0,
    "currency_code": "USD",
    "frequency": "monthly",
    "features": [
      "2,000 WORDS PER MONTH",
      "NO CREDIT CARD REQUIRED",
      "Only 1 user seat",
      "Chat by Copy.ai",
      "90+ copywriting tools",
      "Unlimited projects",
      "Blog Wizard tool",
      "25+ languages",
      "Access to newest features"
    ]
  },
  {
    "plan_name": "PRO",
    "plan_amount": 49,
    "currency_code": "USD",
    "frequency": "monthly",
    "features": [
      "UNLIMITED WORDS",
      "5 user seats",
      "Chat by Copy.ai",
      "90+ copywriting tools",
      "Unlimited projects",
      "Priority email support",
      "25+ languages",
      "Blog Wizard tool",
      "Access to newest features"
    ]
  },
  {
    "plan_name": "ENTERPRISE",
    "plan_amount": null,
    "currency_code": null,
    "frequency": null,
    "features": [
      "Automate Any Workflow",
      "API access",
      "Chat interface",
      "Prebuilt workflows library",
      "Private company Infobase"
    ]
  }
 }

TODO

[ ] - Add Rate limiting

[ ] - Add API support

[ ] - Ability to have interaction with frequency and currency toggles and scrape.

Running Locally

After cloning the repo, run the application in the command line and it will be available at http://localhost:3000.

npm run dev

One-Click Deploy

Deploy the example using Vercel:

Deploy with Vercel