it would take some days for it to be updated in all their data centers.
This is a discussion on Robots.txt question...? within the Web & Server Administration forums, part of the Web Designing & Development category; I just found out that Yahoo search is pulling up pages that I dont want it to. I created a ...
I just found out that Yahoo search is pulling up pages that I dont want it to. I created a robots.txt file that disallows all inside directories, everything but the main page. But I ran a search and the files are still coming up, how long does it take to take effect?
Here's the file:
User-Agent: *
Disallow: /content/
Disallow: /icontact/
Disallow: /images/
Disallow: /logs/
Disallow: /myspace/
Disallow: /tmp/
it would take some days for it to be updated in all their data centers.
Buy / Sell / Trade Products and Services at our Webmaster Marketplace
61 Ways To Drive Targeted Traffic To Your Website
Bookmarks