-
Notifications
You must be signed in to change notification settings - Fork 2
Why Firefox
wget is an excellent & lightweight tool that does exactly what we need - collecting text from a page, but it doesn't follow hidden redirects embedded in Javascript.
We need a sneak attack that will let us scrape the page and can parse these "enhancements" in order to snag the text needed, without ending up with blank postings.
As of version 1.1.0 of Resgen, we're sending a headless browser after the posting, to simulate a user viewing the page.
Versions of Firefox ESR prior to v60 and Firefox prior to v62 are not compatible with Resgen, as Resgen relies upon the Gecko engine built into Firefox; Gecko driver versions are not always backwards compatible with older versions of Firefox.
You don't actually have to use Firefox for anything (if you have another browser preference for daily browsing), other than letting Resgen use it as a dependency.