How do I protect my blog from web spiders?
With the Footprints feature on xanga, I get all kinds of people trying to enter my site from search engines and I don't want that.
Is there a step by step process?
Thanks for the help.
|
Anne
Posts:
507
Registered:
6/26/06
|
|
(10 of 10)
Re: Get my site off of Google
Aug 2, 2006 11:32 AM
|
|
samyakubu, good to have you with us, but this is a forum about online safety. Would you like to say anything about your experience on MySpace, LiveJournal, Bebo, or other social networks? Thanks,
Anne
BlogSafety co-director
|
|
|
samyakubu
Posts:
1
From:
newyork
Registered:
8/2/06
|
|
(9 of 10)
Re: Get my site off of Google
Aug 2, 2006 11:26 AM
|
|
hello.my name is samyakubu.i come from newyork.i like friends who are fnny amd friendly like you that i meet i known you like me.and what i what you to do you will do.pzl do you have friends who have yahoomail or hotmail.and i will add them plz.when it is any message send me
your ever
|
|
|
LovelyLJ
Posts:
3
Registered:
7/30/06
|
|
(8 of 10)
Re: Get my site off of Google
Aug 1, 2006 3:58 AM
|
|
Thank You everyone. Your comments were very helpful. A lot of weird search engine stuff was happening. Other people's pictures were linked to my blog. All these hits from California, Yahoo, and even Normandy were coming up.
It was not something that I liked.
So, thanks.
|
|
|
Anne
Posts:
507
Registered:
6/26/06
|
|
(6 of 10)
Re: Get my site off of Google
Jul 31, 2006 7:54 AM
|
When I interviewed a spokesperson at the Internet Archive, which has its own spider and permanent archive of most of the Web, she told me their spider bots do not archive pages with privacy features turned on. Is your Xanga blog private? If so, the other search engines probaby don't index it either. I have a question in to someone at Xanga about that, but in the meantime, you might check their FAQs or user info about privacy tools and whether they keep you from being indexed in the search engines.
Here's the Internet Archive's FAQ answer on robot txt files, with links to further info.
Anne
BlogSafety co-director |
|
|
LovelyLJ
Posts:
3
Registered:
7/30/06
|
|
(5 of 10)
Re: Get my site off of Google
Jul 31, 2006 7:39 AM
|
|
Thanks, but I don't know how to create a robot txt file and where to put it and so forth.
|
|
|
Michael Goldberg
Posts:
15
From:
West Chester Pa
Registered:
6/22/06
|
|
(4 of 10)
Re: Get my site off of Google
Jul 31, 2006 3:26 AM
|
|
|
|
|
Guest
|
|
(3 of 10)
Re: Get my site off of Google
Jul 30, 2006 10:00 PM
|
|
Just limit the personal info on your xanga instead of not using Xanga at all.
|
|
|
Guest
|
|
(2 of 10)
Re: Get my site off of Google
Jul 30, 2006 9:54 PM
|
|
Not Possible, a short response.
The only time Google removes stuff is when they are spam. I dont think you can ask to remove you page.
|
|
|
LovelyLJ
Posts:
3
Registered:
7/30/06
|
|
(1 of 10)
Get my site off of Google
Jul 30, 2006 3:01 PM
|
|
How do I protect my blog from web spiders?
With the Footprints feature on xanga, I get all kinds of people trying to enter my site from search engines and I don't want that.
Is there a step by step process?
Thanks for the help.
|
|
|
|
|
