watch your P202 logs

[LotsOfZeros]

been seeing a lot of referrals lately with the keyword="inurl:tracking202/redirect"

 

[Bofu2U]

It's called keyword scraping, heh.

 

[LotsOfZeros]

Kind of helpless, really.

 

[volknet]

Would robots.txt fix this?

 

[tortuous]

Would robots.txt fix this?

No, not really.

 

[indianman]

Would robots.txt fix this?

Hello John Chow Jr,

1) Block the domains in your .htaccess file (you know the usual suspects)
2) Block the IPs in your .htaccess file if you are collecting them

Another related point:

Don't add your main converting keywords in your meta tags for someone to copy/paste his way to PPC heaven.

Good luck bro.

 

[LogicFlux]

No, not really.

You're right, p202 includes this robots.txt(at least the newest version does):

# Disallow Web Bots
User-agent: *
Disallow: /

# Disallow Archive Bots
User-agent: ia_archiver
Disallow: /

All the urls being indexed seem to be lp.php and dl.php. Both those pages send http redirect headers so I don't know if you can edit them to include a meta noindex and meta refresh instead of the http redirect or if that would screw things up. The meta noindex would keep google from indexing the url, right? If not then everything else I wrote is moot.

 

[LogicFlux]

This is probably the fix:

Google Indexing URLs blocked by robots.txt

According to that the thing to do is allow google to crawl the url but then serve it with the noindex, nofollow meta tag.

That is, if p202 will not fuck up if you change from a http redirect to a meta redirect. I've just installed prosper so I'm not really sure how it works yet.

I just noticed indianman's post. That might work too.