You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am using scrapyd-client utility to deploy spiders on prod server.
In case to avoid my spiders to be banned, IT support configured forward proxy to hide host IP.
Issue ⚠️
After forward proxy was enabled, scrapy-deploy target -p project command was not available any more.
Server responded with 503 - Forwarding failure (Privoxy@unknown) error and such message:
Prefase 📝
I am using scrapyd-client utility to deploy spiders on prod server.
In case to avoid my spiders to be banned, IT support configured forward proxy to hide host IP.
Issue⚠️
After forward proxy was enabled,
scrapy-deploy target -p project
command was not available any more.Server responded with
503 - Forwarding failure (Privoxy@unknown)
error and such message:Work around 🛠️
I was able to find solution to deploy spiders to JSONAPI scrapyd server.
After doing steps i've mentioned above, i finally managed to deploy project. ✅
Hope, this would help someone in future! ✌🏼
The text was updated successfully, but these errors were encountered: