No site indexing in MSN

i find that happening with my site too, they probably have something messed up.

My site is indexed the most in google. Haven't spent much time with the other search engines having a look.

I was doing some work on the net for my website and found out about something called robots.txt would people suggest I use this as a way to and allow access to web pages on my site.. Is this what it is mainly used for??

robots.txt are used to tell spiders what pages you want to block spider access.

for example: if you got a directory /xyz and dont want google or any search engine to spider it setup the robots.txt and it would do the needful

It just gets placed in the default directory with your html files and will serve the whole site and pages or do you have to create separate robots.txt pages for different parts of the site. E.g. forum, wiki, etc.

no you just need to set it up in the root directory and specify which directories or pages you want to exclude from the search engine crawl

thanks for this good information

yeah ! i guess so that this is because of the maintenance or some other issue, other wise it don't happen actually.