Link not showing up WP-Door needs bot name

Minor and major release and bug fixes requests will be discussed in here. If something just don't work right, or feel right, fire away. We are listening.

Moderators: vrocks, drocd, jdoughs

Locked
PJstarks
Posts: 3
Joined: Fri Feb 25, 2011 8:21 pm

Link not showing up WP-Door needs bot name

Post by PJstarks »

I am having an issue with links not being detected on my site and I am 99% it is my wp-door plugin I use for my warning page. It has a whitelist of bots to allow and I just need the name of the linkspun script bot to add. I assume it is just seeing the warning page and not finding the link VS seeing the real page like google sees or anything else on my whitelist.
drocd
Site Admin
Posts: 126
Joined: Thu Apr 01, 2010 5:56 pm

Re: Link not showing up WP-Door needs bot name

Post by drocd »

If you post the trade url I can help you troubleshoot. The bot actually acts like a browser, so your site shouldn't even know it's a bot.
Linkspun - developer
icq 230-699
PJstarks
Posts: 3
Joined: Fri Feb 25, 2011 8:21 pm

Re: Link not showing up WP-Door needs bot name

Post by PJstarks »

www.hotexgfpics.net
The issue is if you are not on the whitelist like say googlebot or msnbot you will get that warning page asking you to accept and save a cookie. Sites on the whitelist never even know the warning page exists because they go directly to the wordpress index. That is why I keep the list of spiders, but I could not find what your bot identifies itself as. Worse case is if it idents as say firefox it will defeat the purpose of my warning page system because I would have to wihitelist a legit browser which removes my warning from normal web site viewers using that shame browser your bot pretends to be.
drocd
Site Admin
Posts: 126
Joined: Thu Apr 01, 2010 5:56 pm

Re: Link not showing up WP-Door needs bot name

Post by drocd »

I will need to think about how to handle this situation because you are right, our spider is seeing your warning page. Obviously it would be a bad idea for us to have any easily identifiable bot because it would be in invitation for users to abuse that information. In order to truly guarantee that links are placed we need our bots to be anonymous to the site owners.
Linkspun - developer
icq 230-699
PJstarks
Posts: 3
Joined: Fri Feb 25, 2011 8:21 pm

Re: Link not showing up WP-Door needs bot name

Post by PJstarks »

I see your point and feel a little bad about dropping this new and interesting issue in your lap. Please let me know what ends up happening with this stuff and how it lands.
User avatar
CodeR70
Posts: 159
Joined: Sat Nov 27, 2010 6:10 am
Location: Netherlands
Contact:

Re: Link not showing up WP-Door needs bot name

Post by CodeR70 »

drocd wrote:I will need to think about how to handle this situation because you are right, our spider is seeing your warning page. Obviously it would be a bad idea for us to have any easily identifiable bot because it would be in invitation for users to abuse that information. In order to truly guarantee that links are placed we need our bots to be anonymous to the site owners.
How would somebody "abuse" that info? I mean, what would be the goal/gain in that? If somebody would like to use your user agent string... well so be it. It's not much different then you are using a "browser" string now even though your bot is not (speaking of abuse :D ).
User avatar
jdoughs
Site Admin
Posts: 521
Joined: Thu Apr 01, 2010 4:55 pm

Re: Link not showing up WP-Door needs bot name

Post by jdoughs »

CodeR70 wrote:
drocd wrote:I will need to think about how to handle this situation because you are right, our spider is seeing your warning page. Obviously it would be a bad idea for us to have any easily identifiable bot because it would be in invitation for users to abuse that information. In order to truly guarantee that links are placed we need our bots to be anonymous to the site owners.
How would somebody "abuse" that info? I mean, what would be the goal/gain in that? If somebody would like to use your user agent string... well so be it. It's not much different then you are using a "browser" string now even though your bot is not (speaking of abuse :D ).

Any cloaker could own the bot if so, technically they still can but it's a better practice to not be.

This is far from my area of expertise, but I'm fairly well versed in the many black hat methods and tactics, and I can see where it would be sketchy.
ImageImage
User avatar
CodeR70
Posts: 159
Joined: Sat Nov 27, 2010 6:10 am
Location: Netherlands
Contact:

Re: Link not showing up WP-Door needs bot name

Post by CodeR70 »

Yeah, I know. For instance they can only "show" links when the bot is spidering and remove them when Google comes by. But in the end "cheaters" will get caught and get blacklisted, I hope. They can also put up the links now, hit check and remove them after.
Locked