Results 1 to 2 of 2

Robots.txt question...?

This is a discussion on Robots.txt question...? within the Web & Server Administration forums, part of the Web Designing & Development category; I just found out that Yahoo search is pulling up pages that I dont want it to. I created a ...

  1. #1
    Junior Member Array onyxenchanted's Avatar
    Join Date
    Jan 2008
    Posts
    1

    Default Robots.txt question...?

    I just found out that Yahoo search is pulling up pages that I dont want it to. I created a robots.txt file that disallows all inside directories, everything but the main page. But I ran a search and the files are still coming up, how long does it take to take effect?
    Here's the file:

    User-Agent: *
    Disallow: /content/
    Disallow: /icontact/
    Disallow: /images/
    Disallow: /logs/
    Disallow: /myspace/
    Disallow: /tmp/

  2. #2
    Administrator Array SticKer's Avatar
    Join Date
    May 2007
    Posts
    3,700

    Default Re: Robots.txt question...?

    it would take some days for it to be updated in all their data centers.

    Buy / Sell / Trade Products and Services at our Webmaster Marketplace

    61 Ways To Drive Targeted Traffic To Your Website



Similar Threads

  1. Robots.txt Help?
    By Cal S in forum Web & Server Administration
    Replies: 6
    Last Post: 02-27-2012, 06:30 AM
  2. Sitemaps supported via robots.txt
    By SticKer in forum Web & Server Administration
    Replies: 3
    Last Post: 09-19-2011, 09:36 PM
  3. HTML Meta Tags - Robots "index, nofollow"?
    By uranusmcanus in forum Web Design
    Replies: 2
    Last Post: 04-05-2010, 02:21 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
SEO Forum | Web Hosting Forum | Websites For Sale |