Skip to content

A Simple Craigslist Scraper Created using Crawlee to Test the Apify Platform

Notifications You must be signed in to change notification settings

asowder3943/craigslist-scraper

Repository files navigation

Craigslist Scraper V3

Scan craigslist for relevant posts and provides them to an external API

  • Define a search across any number of categories, geographic radi, search terms, etc.
  • Leverage Apify online orchestration to preform browser automations in a cloud environment or on a local docker container.
  • Recieve downtime notifications using external Healthcheck api.
  • Includes tests for verifying functionality of all supported search parameters.
  • Includes custom typing for all dataclasses.
  • Includes recommended vscode extensions for quick onboarding of potential contributors.

Example Use Cases

  • Custom Craigslist Clients
  • Custom RSS feed Generation
  • Lead Generation
  • Scam investigations

Example Output

image

Personal Note

I love Craigslist. I used it to by my first car. I used it to furnash my first apartment. I used it to find one of my first farmhand jobs. I have even attempted to use it to track down my lost wallet. It is a simple site tied to a lot of great memories and great personal interactions. I am an avid user of the platform. Please be respectful if choosing to use this automation. May your requests be efficient and as infrequent as possible.

image

First Craigslist Car: cost me $300 and a TV

Craigslist Categories

Tag Name Parent Category
ccc all-community Community
act activities Community
ats artists Community
kid childcare Community
cls classes Community
eve events Community
com general Community
grp groups Community
vnn local news Community
laf lost found Community
mis missed connections Community
muc musicians Community
pet pets Community
pol politics Community
rnr rants raves Community
rid rideshare Community
vol volunteers Community
bbb all-services Services
aos automotive Services
bts beauty Services
cms cell/mobile Services
cps computer Services
crs creative Services
cys cycle Services
evs event Services
fgs farm+garden Services
fns financial Services
hws health/well Services
hss household Services
lbs labor/move Services
lgs legal Services
lss lessons Services
mas marine Services
pas pet Services
rts real estate Services
sks skilled trade Services
biz sm biz ads Services
trv travel/vac Services
wet write/ed/tran Services
hhh all-housing Housing
apa apts / housing Housing
swp housing swap Housing
hsw housing wanted Housing
off office / commercial Housing
prk parking / storage Housing
rea real estate for sale Housing
roo rooms / shared Housing
sha rooms wanted Housing
sub sublets / temporary Housing
vac vacation rentals Housing
sss all-for sale For Sale
ata antiques For Sale
ppa appliances For Sale
ara arts+crafts For Sale
sna atv/utv/sno For Sale
pta auto parts For Sale
ava aviation For Sale
baa baby+kid For Sale
bar barter For Sale
haa beauty+hlth For Sale
bip bike parts For Sale
bia bikes For Sale
bpa boat parts For Sale
boo boats For Sale
bka books For Sale
bfa business For Sale
cta cars+trucks For Sale
ema cds/dvd/vhs For Sale
moa cell phones For Sale
cla clothes+acc For Sale
cba collectibles For Sale
syp computer parts For Sale
sya computers For Sale
ela electronics For Sale
gra farm+garden For Sale
zip free For Sale
fua furniture For Sale
gms garage sale For Sale
foa general For Sale
hva heavy equip For Sale
hsa household For Sale
jwa jewelry For Sale
maa materials For Sale
mpa motorcycle parts For Sale
mca motorcycles For Sale
msa music instr For Sale
pha photo+video For Sale
rva rvs+camp For Sale
sga sporting For Sale
tia tickets For Sale
tla tools For Sale
taa toys+games For Sale
tra trailers For Sale
vga video gaming For Sale
waa wanted For Sale
wta wheels+tires For Sale
jjj all-jobs Jobs
acc accounting+finance Jobs
ofc admin / office Jobs
egr arch / engineering Jobs
med art / media / design Jobs
sci biotech / science Jobs
bus business / mgmt Jobs
csr customer service Jobs
edu education Jobs
etc etc / misc Jobs
fbh food / bev / hosp Jobs
lab general labor Jobs
gov government Jobs
hum human resources Jobs
lgl legal / paralegal Jobs
mnu manufacturing Jobs
mar marketing / pr / ad Jobs
hea medical / health Jobs
npo nonprofit sector Jobs
rej real estate Jobs
ret retail / wholesale Jobs
sls sales / biz dev Jobs
spa salon / spa / fitness Jobs
sec security Jobs
trd skilled trade / craft Jobs
sof software / qa / dba Jobs
sad systems / network Jobs
tch technical support Jobs
trp transport Jobs
tfr tv / film / video Jobs
web web / info design Jobs
wri writing / editing Jobs
ggg all-gigs Gigs
cpg computer Gigs
crg creative Gigs
cwg crew Gigs
dmg domestic Gigs
evg event Gigs
lbg labor Gigs
tlg talent Gigs
wrg writing Gigs
rrr resumes Resumes

Craigslist Subdomains

SUBDOMAIN NAME
auburn auburn
bham birmingham
dothan dothan
shoals florence muscle shoals
gadsden gadsden-anniston
huntsville huntsville decatur
montgomery montgomery
tuscaloosa tuscaloosa
anchorage anchorage mat-su
fairbanks fairbanks
kenai kenai peninsula
juneau southeast alaska
flagstaff flagstaff sedona
mohave mohave county
phoenix phoenix
prescott prescott
showlow show low
sierravista sierra vista
tucson tucson
yuma yuma
fayar fayetteville
fortsmith fort smith
jonesboro jonesboro
littlerock little rock
texarkana texarkana
bakersfield bakersfield
chico chico
fresno fresno madera
goldcountry gold country
hanford hanford-corcoran
humboldt humboldt county
imperial imperial county
inlandempire inland empire
losangeles los angeles
mendocino mendocino county
merced merced
modesto modesto
monterey monterey bay
orangecounty orange county
palmsprings palm springs
redding redding
sacramento sacramento
sandiego san diego
sfbay san francisco bay area
slo san luis obispo
santabarbara santa barbara
santamaria santa maria
siskiyou siskiyou county
stockton stockton
susanville susanville
ventura ventura county
visalia visalia-tulare
yubasutter yuba-sutter
boulder boulder
cosprings colorado springs
denver denver
eastco eastern CO
fortcollins fort collins north CO
rockies high rockies
pueblo pueblo
westslope western slope
newlondon eastern CT
hartford hartford
newhaven new haven
nwct northwest CT
delaware delaware
washingtondc washington
daytona daytona beach
keys florida keys
fortmyers ft myers SW florida
gainesville gainesville
cfl heartland florida
jacksonville jacksonville
lakeland lakeland
miami miami dade
lakecity north central FL
ocala ocala
okaloosa okaloosa walton
orlando orlando
panamacity panama city
pensacola pensacola
sarasota sarasota-bradenton
spacecoast space coast
staugustine st augustine
tallahassee tallahassee
tampa tampa bay area
treasure treasure coast
albanyga albany
athensga athens
atlanta atlanta
augusta augusta
brunswick brunswick
columbusga columbus
macon macon warner robins
nwga northwest GA
savannah savannah hinesville
statesboro statesboro
valdosta valdosta
honolulu hawaii
boise boise
eastidaho east idaho
lewiston lewiston clarkston
twinfalls twin falls
bn bloomington-normal
chambana champaign urbana
chicago chicago
decatur decatur
lasalle la salle co
mattoon mattoon-charleston
peoria peoria
rockford rockford
carbondale southern illinois
springfieldil springfield
quincy western IL
bloomington bloomington
evansville evansville
fortwayne fort wayne
indianapolis indianapolis
kokomo kokomo
tippecanoe lafayette west lafayette
muncie muncie anderson
richmondin richmond
southbend south bend michiana
terrehaute terre haute
ames ames
cedarrapids cedar rapids
desmoines des moines
dubuque dubuque
fortdodge fort dodge
iowacity iowa city
masoncity mason city
quadcities quad cities
siouxcity sioux city
ottumwa southeast IA
waterloo waterloo cedar falls
lawrence lawrence
ksu manhattan
nwks northwest KS
salina salina
seks southeast KS
swks southwest KS
topeka topeka
wichita wichita
bgky bowling green
eastky eastern kentucky
lexington lexington
louisville louisville
owensboro owensboro
westky western KY
batonrouge baton rouge
cenla central louisiana
houma houma
lafayette lafayette
lakecharles lake charles
monroe monroe
neworleans new orleans
shreveport shreveport
maine maine
annapolis annapolis
baltimore baltimore
easternshore eastern shore
frederick frederick
smd southern maryland
westmd western maryland
boston boston
capecod cape cod islands
southcoast south coast
westernmass western massachusetts
worcester worcester central MA
annarbor ann arbor
battlecreek battle creek
centralmich central michigan
detroit detroit metro
flint flint
grandrapids grand rapids
holland holland
jxn jackson
kalamazoo kalamazoo
lansing lansing
monroemi monroe
muskegon muskegon
nmi northern michigan
porthuron port huron
saginaw saginaw-midland-baycity
swmi southwest michigan
thumb the thumb
up upper peninsula
bemidji bemidji
brainerd brainerd
duluth duluth superior
mankato mankato
minneapolis minneapolis st paul
rmn rochester
marshall southwest MN
stcloud st cloud
gulfport gulfport biloxi
hattiesburg hattiesburg
jackson jackson
meridian meridian
northmiss north mississippi
natchez southwest MS
columbiamo columbia jeff city
joplin joplin
kansascity kansas city
kirksville kirksville
loz lake of the ozarks
semo southeast missouri
springfield springfield
stjoseph st joseph
stlouis st louis
billings billings
bozeman bozeman
butte butte
greatfalls great falls
helena helena
kalispell kalispell
missoula missoula
montana eastern montana
grandisland grand island
lincoln lincoln
northplatte north platte
omaha omaha council bluffs
scottsbluff scottsbluff panhandle
elko elko
lasvegas las vegas
reno reno tahoe
nh new hampshire
cnj central NJ
jerseyshore jersey shore
newjersey north jersey
southjersey south jersey
albuquerque albuquerque
clovis clovis portales
farmington farmington
lascruces las cruces
roswell roswell carlsbad
santafe santa fe taos
albany albany
binghamton binghamton
buffalo buffalo
catskills catskills
chautauqua chautauqua
elmira elmira-corning
fingerlakes finger lakes
glensfalls glens falls
hudsonvalley hudson valley
ithaca ithaca
longisland long island
newyork new york city
oneonta oneonta
plattsburgh plattsburgh-adirondacks
potsdam potsdam-canton-massena
rochester rochester
syracuse syracuse
twintiers twin tiers NY/PA
utica utica-rome-oneida
watertown watertown
asheville asheville
boone boone
charlotte charlotte
eastnc eastern NC
fayetteville fayetteville
greensboro greensboro
hickory hickory lenoir
onslow jacksonville
outerbanks outer banks
raleigh raleigh durham CH
wilmington wilmington
winstonsalem winston-salem
bismarck bismarck
fargo fargo moorhead
grandforks grand forks
nd north dakota
akroncanton akron canton
ashtabula ashtabula
athensohio athens
chillicothe chillicothe
cincinnati cincinnati
cleveland cleveland
columbus columbus
dayton dayton springfield
limaohio lima findlay
mansfield mansfield
sandusky sandusky
toledo toledo
tuscarawas tuscarawas co
youngstown youngstown
zanesville zanesville cambridge
lawton lawton
enid northwest OK
oklahomacity oklahoma city
stillwater stillwater
tulsa tulsa
bend bend
corvallis corvallis/albany
eastoregon east oregon
eugene eugene
klamath klamath falls
medford medford-ashland
oregoncoast oregon coast
portland portland
roseburg roseburg
salem salem
altoona altoona-johnstown
chambersburg cumberland valley
erie erie
harrisburg harrisburg
lancaster lancaster
allentown lehigh valley
meadville meadville
philadelphia philadelphia
pittsburgh pittsburgh
poconos poconos
reading reading
scranton scranton wilkes-barre
pennstate state college
williamsport williamsport
york york
providence rhode island
charleston charleston
columbia columbia
florencesc florence
greenville greenville upstate
hiltonhead hilton head
myrtlebeach myrtle beach
nesd northeast SD
csd pierre central SD
rapidcity rapid city west SD
siouxfalls sioux falls SE SD
sd south dakota
chattanooga chattanooga
clarksville clarksville
cookeville cookeville
jacksontn jackson
knoxville knoxville
memphis memphis
nashville nashville
tricities tri-cities
abilene abilene
amarillo amarillo
austin austin
beaumont beaumont port arthur
brownsville brownsville
collegestation college station
corpuschristi corpus christi
dallas dallas fort worth
nacogdoches deep east texas
delrio del rio eagle pass
elpaso el paso
galveston galveston
houston houston
killeen killeen temple ft hood
laredo laredo
lubbock lubbock
mcallen mcallen edinburg
odessa odessa midland
sanangelo san angelo
sanantonio san antonio
sanmarcos san marcos
bigbend southwest TX
texoma texoma
easttexas tyler east TX
victoriatx victoria
waco waco
wichitafalls wichita falls
logan logan
ogden ogden-clearfield
provo provo orem
saltlakecity salt lake city
stgeorge st george
vermont vermont
charlottesville charlottesville
danville danville
fredericksburg fredericksburg
norfolk hampton roads
harrisonburg harrisonburg
lynchburg lynchburg
blacksburg new river valley
richmond richmond
roanoke roanoke
swva southwest VA
winchester winchester
bellingham bellingham
kpr kennewick-pasco-richland
moseslake moses lake
olympic olympic peninsula
pullman pullman moscow
seattle seattle-tacoma
skagit skagit island SJI
spokane spokane coeur d'alene
wenatchee wenatchee
yakima yakima
charlestonwv charleston
martinsburg eastern panhandle
huntington huntington-ashland
morgantown morgantown
wheeling northern panhandle
parkersburg parkersburg-marietta
swv southern WV
wv west virginia (old)
appleton appleton-oshkosh-FDL
eauclaire eau claire
greenbay green bay
janesville janesville
racine kenosha-racine
lacrosse la crosse
madison madison
milwaukee milwaukee
northernwi northern WI
sheboygan sheboygan
wausau wausau
wyoming wyoming

About

A Simple Craigslist Scraper Created using Crawlee to Test the Apify Platform

Topics

Resources

Stars

Watchers

Forks