Meta Robots Tag Generator

Choose indexing and crawling directives (index/noindex, follow/nofollow, noarchive, nosnippet and more) to generate a meta robots tag or X-Robots-Tag HTTP header.

Allow indexingUncheck to add noindexFollow linksUncheck to add nofollownoarchiveDon't show a cached copynosnippetDon't show a text snippetnoimageindexDon't index images on this pagenotranslateDon't offer a translation

max-snippet (optional)

HTML meta tag

<meta name="robots" content="index, follow" />

HTTP header (for non-HTML files like PDFs)

X-Robots-Tag: index, follow

Ad space

Frequently asked questions

What's the difference between robots.txt and a meta robots tag?+

robots.txt tells crawlers which URLs they may request at all; a meta robots tag controls what a crawler does with a page it has already been allowed to fetch, like whether to index it.

When would I use the X-Robots-Tag HTTP header instead?+

For non-HTML files like PDFs or images, where you can't add an HTML <meta> tag; the header achieves the same effect at the server response level.

What does max-snippet do?+

It limits the length of the text snippet Google can show in search results for that page; set it to -1 for no limit, or 0 to disable snippets entirely.