Time For A Restful Harvest
This is a big release due to the rest API being introduced and I expect the community will have fun playing with it. There are a lot of changes for this release. Please be aware of that when Spyse drop support for v3 of there API that module will break due to me not having a paid account to be able to update to the new version of the API. Community support on getting this module updated would be much appreciated.
The changes for this release are the following;
What's New
New Modules Added:
Anubis
BinaryEdge
Rocket Reach
ZoomEye
-
JSON output
-
More Information Collected:
* Now collects ASNs and interesting urls
* Shodan collects much more information -
Fully Asynchronous Rest API written with FastAPI created, use restfulHarvest to start it
-
Added .dockerignore to decrease size of container
-
new unit tests
-
Added restfulHarvest to setup.py to get installed the same as theHarvester binary
-
Added new dependencies for the restAPI
Bug Fixes
- Censys module is fixed thanks to thehappydinoa fixing this so we support the censys 2.0.x SDK
What's Changed
- Removed exalead module (triggered captcha after one query and not very fruitful results)
- Removed HTML reporting (can still be used if wanted with manual tweaking just use the code from older version)
- Made screenshotting less resource intensive
- CI changes
- Removed pipenv files
- Removed uneeded dependencies
- Update DNS brute forcing lists to find more subdomains when doing a DNS brute force
- Docker container works with version 4.0.0 of theHarvester and due to this was moved to Ubuntu due to compatibility issues with alpine
- Update dependencies
- Add new entries for new modules to api-keys.yaml
- Misc changes all over the place