You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I can fetch it ok with Scrapy fetch, but if I try to use a spider that crawls the URL, I hit a 302 redirect and my crawl just completely errors out from that point with immediate failures "response never received". It's not long timeouts, it's literally just erroring immediately.
Please could somebody help me? I'm fairly new to this and I have no idea what the cause may be.
I'm using a pool of 10 http proxies on port 80
The text was updated successfully, but these errors were encountered:
mmotti
changed the title
Timeout errors
Response never received errors
Dec 19, 2020
Does anyone else experience timeout errors, specifically immediately after redirects?
I've only set this up today, but specifically https://www.game.co.uk/en/hardware/xbox-series-x/?contentOnly=&inStockOnly=true&listerOnly=&pageSize=100
I can fetch it ok with Scrapy fetch, but if I try to use a spider that crawls the URL, I hit a 302 redirect and my crawl just completely errors out from that point with immediate failures "response never received". It's not long timeouts, it's literally just erroring immediately.
Please could somebody help me? I'm fairly new to this and I have no idea what the cause may be.
I'm using a pool of 10 http proxies on port 80
The text was updated successfully, but these errors were encountered: