A capture tool used to capture pictures from web like Sina, LOFTER, huaban and so on.
If you have any suggestions or awesome websites of pictures want to capture, please let me know!!!
- Sina
- Lofter
- Toutiao
QQZone: Need verify Captcha- Huaban
Vmgirls: Website upgraded- Fabiaoqing
telegram
- NetBian
- install
python3
and libs - update your Parameters of each kind of web
- run
./capturer
or runmain.py
or***_spider.py
to capture images fromsina
lofter
toutiao
qqzone
telegram
netbian
- run
huaban/run.py
to capture images fromhuaban
- run
vmgirls/run.py
to capture images fromvmgirls
- run
fabiaoqing/fabiaoqing_spider.py key1 [key2] [key3] ...
Almost all of the file path based on ~/Pictures/python
, ~
means home dir.
USERNAME
: username of huaban which you want to captureROOT_DIR
: directories where to store the images
uid
: user-id(10 numbers) of sina weibo that you want to capturecookies
: your cookies after login the sina weibopath
: directory to save the pictures
username
: username of lofter that you want to capturepath
: directory to save the pictures, see the function_get_path
inlofter_spider.py
query_number
: number of blogs in each query packet, default value is 40
api_id
: you can get from https://my.telegram.org/appsapi_hash
: you can get from https://my.telegram.org/appssocks proxy
: set proxy ip and port, default islocalhost:1080
You can find all the relate blogs in https://www.litreily.top/tags/spider/.
- Lofter - 爬取网易LOFTER图片
- Sina - 爬取新浪微博用户图片
- qqzone - 爬取QQ空间相册
- Vmgirls - Scrapy爬取vmgirls
- Netbian - 爬取彼岸图网美图