Page 1 of 1
Scanner not finding links on this trade
Posted: Thu Jun 10, 2010 8:08 pm
by vrocks
Re: Scanner not finding links on this trade
Posted: Thu Jun 10, 2010 8:15 pm
by drocd
I suspect there is something wrong with that domain. This is not the first time it has had problems retrieving that page. The error from the spider is "Error: Couldn't resolve host 'domain-removed.us'".
Maybe in the future we can make the spider display extra information if a link wasn't found, or if the page could not be loaded for whatever reason.
Re: Scanner not finding links on this trade
Posted: Thu Jun 10, 2010 10:39 pm
by vrocks
That sounds kinky!
Re: Scanner not finding links on this trade
Posted: Thu Jun 10, 2010 10:47 pm
by vrocks
Seems their server doesn't understand HTTP/1.1 and when I used 1.0 it does.
Re: Scanner not finding links on this trade
Posted: Sat Jan 29, 2011 5:13 pm
by jdoughs
As far as I know, that users sites have all been spidering fine for a couple months now, closed.