LinkBack URL
About LinkBacks
you are restricting indexing of your website pages?
This is a discussion on Robots.txt Help? within the Web & Server Administration forums, part of the Web Designing & Development category; On my website (http://www.nuttysoftware.com) the main index file redirects to another page but google finds the page in searches, how ...
Robots.txt Help?
On my website (http://www.nuttysoftware.com) the main index file redirects to another page but google finds the page in searches, how can i stop this?
My robots.txt:
User-agent: *
Allow: /apps/
Disallow: index
(i want it to find /apps but not the www. index)
Re: Robots.txt Help?
you are restricting indexing of your website pages?
Jake world
Performance Chips
Re: Robots.txt Help?
Hello,
It is help to crawl the website in a search engine::::::::::
Re: Robots.txt Help?
Used to crawl the someone site:::::::
Re: Robots.txt Help?
Used to crawl the website!!!!!
Re: Robots.txt Help?
A robots.txt file restricts access to your site by search engine robots that crawl the web. These bots are automated, and before they access pages of a site, they check to see if a robots.txt file exists that prevents them from accessing certain pages.
You need a robots.txt file only if your site includes content that you don't want search engines to index. If you want search engines to index everything in your site, you don't need a robots.txt file
Ultimatehostings
Fully Managed Services
Re: Robots.txt Help?
Your website does not seem to exist.
It depends whether your host allows you to change the robots file. Most blogs dont allow this.
Posting Permissions
Bookmarks