Results 1 to 5 of 5

What is the X-Robots tag?

This is a discussion on What is the X-Robots tag? within the Search Engine Optimization forums, part of the Internet Marketing category; hi friends, What is the X-Robots tag?...

  1. #1
    Senior Member orientation's Avatar
    Join Date
    Feb 2016
    Location
    Bangalore
    Posts
    108

    Default What is the X-Robots tag?

    hi friends,

    What is the X-Robots tag?

  2. #2
    Newbie
    Join Date
    May 2016
    Posts
    2

    Default Re: What is the X-Robots tag?

    It can be used as an element of the HTTP header response for a given URL. You can add the it to a site's HTTP responses using .htaccess and httpd.conf files which are by default available on Apache based web servers.

    Benefit of using an X-Robots-Tag with HTTP responses :

    • It can be applied globally across a site.
    • You can use it for non-HTML files like document or image files where the usage of robots meta tags is not possible.
    • You can use regular expressions for high quality flexibility for complex url or content.
    • Like Robots Meta Tag, you can use other attributes for your page like nosnippet, noodp, notranslate etc.


    For Example,
    Adding a noindex X-Robots-Tag directive for images files (.png, .jpeg, .jpg, .gif) across an entire site:

    <Files ~ "\.(png|jpe?g|gif)$">
    Header set X-Robots-Tag "noindex"
    </Files>

  3. #3
    Senior Member
    Join Date
    Jul 2012
    Location
    india
    Posts
    269

    Default Re: What is the X-Robots tag?

    The X-Robots-Tag can be used as an element of the HTTP header response for a given URL. Any directive that can be used in an robots meta tag can also be specified as an X-Robots-Tag.

  4. #4
    Senior Member
    Join Date
    Jan 2012
    Posts
    1,964

    Default Re: What is the X-Robots tag?

    The X-Robots-Tag can be used as an element of the HTTP header response for a given URL. Any directive that can be used in an robots meta tag can also be specified as an X-Robots-Tag.

  5. #5
    Senior Member RH-Calvin's Avatar
    Join Date
    Jun 2013
    Posts
    3,351

    Default Re: What is the X-Robots tag?

    The X-Robots-Tag can be used as an element of the HTTP header response for a given URL. Any directive that can be used in an robots meta tag can also be specified as an X-Robots-Tag.
    Cheap VPS | $1 VPS Hosting | Windows with Remote Desktop
    Cheap Dedicated Server | $29 Dedicated Server with Free IPMI Setup