sbr-examples

Examples of Bright Data's Scraping Browsers usage using common browser-control libraries.

• *-basic: simple scraping of targeted page
• *-captcha: open a page and wait for captcha to solve
• *-advanced: inspect scraping session, advanced scraping using js snippets
• *-proxy-location: change proxy location before scraping
• *-file-download: get browser's download

How to run examples

You need to get Scraping Browsers credentials in the control panel. Pass it in format USER:PASS as environment variable AUTH

for unix shell:

export AUTH=brd-customer-hl_01234567-zone-scraping_browser:abcdefghijkl

for windows cmd:

set AUTH=brd-customer-hl_01234567-zone-scraping_browser:abcdefghijkl

for powershell:

$Env:AUTH = 'brd-customer-hl_01234567-zone-scraping_browser:abcdefghijkl'

You can also pass TARGET_URL environment variable to change default targeted website.

nodejs

To install required libraries use npm package manager

$ cd nodejs/puppeteer-basic
.../puppeteer-basic$ npm install
.../puppeteer-basic$ node scrape.js

python

To install required libraries use pip package manager

$ cd python/playwright-async-basic
.../playwright-async-basic$ pip3 install -r requirements.txt
.../playwright-async-basic$ python3 scrape.py

csharp

Use dotnet utility to install required libraries, build and run

$ cd csharp/puppeteer-basic
.../puppeteer-basic$ dotnet run

java

Use maven tool to package executable jar file with required libraries

$ cd java/playwright-basic
.../playwright-basic$ mvn package
.../playwright-basic$ java -jar target/sbr-examples-1.0.jar

golang

Use go toolchan to install required libraries, build and run

$ cd golang/playwright-basic
.../golang/playwright-basic$ go get
.../golang/playwright-basic$ go run scrape.go