differentiate between link not found and page not found

[AmateurFlix]

if a page is not found due to a server being down or the spider not being able to access it for some reason (my current predicament), that would usually indicate a temporary technical difficulty, whereas the link simply not being found on the page is more likely to indicate a different intent.

[jdoughs]

if a page is not found due to a server being down or the spider not being able to access it for some reason (my current predicament), that would usually indicate a temporary technical difficulty, whereas the link simply not being found on the page is more likely to indicate a different intent.

Yep this is a good idea, and we've been talking about 'defining' link errors for a while, when we do get it live, it will also email/alert you if your domains drop, or hosting is suspended.

We just need to teach the spider what each results looks like and behaves like, get some key things to compare/look for in each instance and go with it.