How do I get the url to stay the same when using a redirect script?
View Single Post
04-03-2009, 03:38 PM
Join Date: Mar 2009
Location: Springfield, IL USA
Nah, you don't still need to check the stats.
As far as them spoofing the header for a link, yes -- they do do it.
Look at the example I gave with the online proxy site. I'll explain a little more detail of it.
The guy that owned the proxy set his proxy to point at my site. I use full urls inside every link of my site (e.g., mydomain.com/folder/page.htm) and his proxy spoofed HTTP headers.
My URL was actually stripped out of the code and replaced with his url. So my internal links looked like hisdomain.com/folder/page.htm
In the browser bar his url was showing at the top with my content in it.
It showed my own pages as the http referer because he spoofed the headers.
Every single page of my site (50,000 pages) were indexed in google under his crap. It took weeks to get it all sorted. It caused a lot of grief for my site in the SERPs during that time, also.
Your site may not be a target because I don't know how big it is, or what the PR is. But when a blackhat sees a very large site that they can do this to, they aim for it. This same guy even did this to George Bush's website.
I code things differently now, as a result of that experience. What I mean is, I use host lookup and if the IP/host is from a domain I don't want to access my site it punts them and they get shown a page that tells them they don't have access to this domain -- no matter what page they look at on the site.
This stops the fake googlebots too. There's a few rogue scrapers out there that use the user-agent googlebot but they're not googlebot.
So, with host lookup it grabs the IP and dns and determines if it's really google or not. If it is, it's allowed to crawl the site. If it isn't, it punts them -- same message as the other ones get.
However, the ones running automated scripts to hammer the server get a different response. My system sends the request right back to them (like a redirect) heh heh.
View Public Profile
Send a private message to WebSavvy
Find More Posts by WebSavvy