Repositories list

• zyte-common-items

  Public
  Contains the common item definitions used in Zyte.

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •7•9•3•6•Updated Dec 20, 2024Dec 20, 2024

• zyte-spider-templates

  Public
  Spider templates for automatic crawlers.

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •5•24•11•3•Updated Dec 19, 2024Dec 19, 2024

• zyte-spider-templates-project

  Public
  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •9•17•0•2•Updated Dec 16, 2024Dec 16, 2024

• web-snap

  Public
  Create "perfect" snapshots of web pages

  web-archivingweb-archivesplaywright+ 2capture-pagejavascript

  JavaScript

  •

  MIT License

  •3•31•0•5•Updated Dec 15, 2024Dec 15, 2024

• zyte-parsers

  Public
  HTML

  •

  MIT License

  •3•12•1•1•Updated Dec 12, 2024Dec 12, 2024

• http-parser

  Public
  Fork of 'https://github.com/benoitc/http-parser'

  C

  •

  Other

  •95•0•0•0•Updated Nov 14, 2024Nov 14, 2024

• duplicate-url-discarder-rules

  Public
  Contains rules for https://github.com/zytedata/duplicate-url-discarder.

  Python

  •

  MIT License

  •1•0•0•0•Updated Nov 5, 2024Nov 5, 2024

• extract-summit-contest-solutions

  Public
  Example solutions for the practice and contest websites of the code contest of Web Data Extraction Summit.

  Python

  •

  MIT License

  •2•5•0•0•Updated Oct 21, 2024Oct 21, 2024

• url-matcher

  Public
  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •2•8•1•0•Updated Oct 16, 2024Oct 16, 2024

• python-zyte-api

  Public
  Python client for Zyte API

  hacktoberfest

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •5•22•7•2•Updated Oct 16, 2024Oct 16, 2024

• html-text

  Public
  HTML

  •

  MIT License

  •0•11•3•0•Updated Oct 16, 2024Oct 16, 2024

• duplicate-url-discarder

  Public
  Python

  •

  MIT License

  •1•4•7•1•Updated Oct 16, 2024Oct 16, 2024

• clear-html

  Public
  Remove DIVs, style stuff and normalize HTML preserving structure information

  Python

  •

  MIT License

  •1•8•0•0•Updated Oct 16, 2024Oct 16, 2024

• spidyquotes

  Public
  Example site for web scraping tutorials

  playgroundscrapingcrawling+ 4tutorialsweb-scrapingweb-crawlingweb-scraping-tutorials

  Julia

  •

  BSD 3-Clause "New" or "Revised" License

  •17•31•3•3•Updated Oct 9, 2024Oct 9, 2024

• rrweb

  Public
  record and replay the web

  TypeScript

  •

  MIT License

  •1.4k•0•0•3•Updated Sep 14, 2024Sep 14, 2024

• geventhttpclient

  Public
  A high performance, concurrent http client library for python with gevent

  Python

  •

  Other

  •137•0•0•1•Updated Sep 3, 2024Sep 3, 2024

• openvscode-server

  Public
  Run upstream VS Code on a remote machine with access through a modern web browser from any device, anywhere.

  TypeScript

  •

  MIT License

  •30k•0•0•4•Updated Aug 30, 2024Aug 30, 2024

• unsloth_docker

  Public
  A working Dockerfile that has unsloth with all the other dependencies

  Dockerfile

  •0•1•0•0•Updated Aug 23, 2024Aug 23, 2024

• zyte-api-workshop

  Public
  Python

  •0•1•0•7•Updated Jul 29, 2024Jul 29, 2024

• spidermon-workshop

  Public
  Python

  •

  GNU General Public License v3.0

  •0•1•0•2•Updated May 14, 2024May 14, 2024

• onefile

  Public
  Merge multiples files into one!

  HTML

  •

  MIT License

  •0•1•0•0•Updated Apr 2, 2024Apr 2, 2024

• scrapy-time-machine

  Public
  Run your spider against a site's snapshot

  Python

  •

  MIT License

  •2•5•0•0•Updated Feb 1, 2024Feb 1, 2024

• web-scraping-tutorial-project

  Public
  https://docs.zyte.com/web-scraping/tutorial/index.html

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •2•5•0•1•Updated Jan 18, 2024Jan 18, 2024

• installimage

  Public
  Bash scripts to universally deploy various distributions

  Shell

  •

  Other

  •143•1•0•0•Updated Jan 10, 2024Jan 10, 2024

• kafka-manager

  Public
  A tool for managing Apache Kafka.

  kafkakafka-manager

  Scala

  •

  Apache License 2.0

  •2.5k•4•0•0•Updated Jan 9, 2024Jan 9, 2024

• dj-cloud-task

  Public
  Django Cloud Task Queue. Integrate your Django Application with Google Cloud Task from Google Cloud Platform

  Python

  •

  MIT License

  •4•0•0•0•Updated Dec 19, 2023Dec 19, 2023

• sctools

  Public
  Analyze your jobs on scrapy cloud

  zytescrapy-cloudscrapy

  Clojure

  •

  Other

  •1•5•0•0•Updated Oct 30, 2023Oct 30, 2023

• locust

  Public
  Write scalable load tests in plain Python 🚗💨

  Python

  •

  MIT License

  •3k•0•0•0•Updated Sep 13, 2023Sep 13, 2023

• zyte-smartproxy-selenium

  Public
  A wrapper over Selenium Wire to provide Zyte Smart Proxy Manager specific functionalities.

  Python

  •4•3•1•0•Updated Sep 5, 2023Sep 5, 2023

• shifter-webhook-artifact-created

  Public
  Shell

  •25•0•0•0•Updated Aug 17, 2023Aug 17, 2023