03-09-2008, 06:20 AM
|
#6 (permalink)
|
|
The Contributor
Join Date: Sep 2007
Location: Finland
Posts: 45
Thanks: 3
|
Well Alan I have put both admin-area and member-area theyr own subdomain whit login ofcourse.
Robots.txt contains
Code:
User-agent: *
Disallow: /
and I have meta tag
Code:
<meta name="robots" content="none" />
And yes now that you mention it that crawlers are visiting as guest so, when i do have login, they wont go any further! Just didn't got it before! ;)
But still, there is sensitive data both areas, do I need to consider SSL?
Thanks for all help!
|
|
|