meta name="robots"Element
<meta name="robots"
<meta name="robots" provides instructions to all search engines.
The meta name="robots" element can be used to tell robots not to index the content of a page, not to follow the links in a page, or both.
Robots can and will ignore the meta name="robots" element; do not worry about directing malware bots to your content; the meta name="robots" element is for standards-compliant, well-behaved bots.
Multiple values are allowed in a single meta name="robots" element; if you are not preventing bots from your content, don’t worry about meta name="robots" element, the default (not using one) is content="index, follow".
<meta name="robots"
meta name="robots" content="noindex,nofollow" />
Tells the bots not to index the page’s contents nor follow its links.
<meta name="robots" content="noindex,nofollow" />
meta name="robots" content="noodp" />
To prevent all search engines (that support the meta tag) from using this information for the page’s description, use the following:
content="noodp" stands for No Open Directory Project; Google sometimes uses descriptions from the Open Directory Project to generate the title and description snippets that can be seen in serps; this is telling all Search Engines to not use anything from the Open Directory Project.
<meta name="robots" content="noodp" />
<meta name="robots" content="noindex" />
content="noindex" tells search engines to deny the page from being indexed.
<meta name="robots" content="noindex" />
<meta name="robots" content="nofollow" />
content="nofollow" tells search engines to not follow any links on the page.
<meta name="robots" content="nofollow" />
<meta name="robots" content="noarchive" />
content="noarchive" tells search engines to not provide a cached copy of page in search results.
<meta name="robots" content="noarchive" />
<meta name="robots" content="nosnippet" />
content="nosnippet" tells search engines to not include a description of the page in search results as well as prevents caching of the page.
<meta name="robots" content="nosnippet" />
<meta name="robots" content="none" />
content="none" the same as using content="noindex, nofollow". Note: don’t confuse content="none" as an indicator of no robots restrictions. It will block all search engines from your content.
<meta name="robots" content="none" />
<meta name="robots" content="noimageindex" />
<meta name="robots" content="noimageindex" />tells Google Images Search results not to use your site as a referring page. Note: images on the page may still be included in the image index if they are linked to by other pages.
<meta name="robots" content="noimageindex" />
<meta name="googlebot"
<meta name="googlebot" provides instructions to only Googlebot.
<meta name="googlebot"
Googlebot by default indexes pages and follows links, so you don’t need to add content="index" or content="follow". What about other search engines/bots?
If you use conflicting values, Googlebot will follow the most restrictive.
meta name="googlebot" content="noodp" />
To specifically prevent Googlebot from using this information for a page’s description, use the following:
This is telling Google specifically not to use anything from the Open Directory Project.
<meta name="googlebot" content="noodp" />
If you use the robots meta element for other directives, you can combine those. For instance:
<meta name="googlebot" content="noodp, nofollow" />
<meta name="googlebot" content="noindex,noarchive,nofollow" />
Tells the googlebot not to index the page’s content, not to follow its links and not to provide a cached copy of the page in serps.
<meta name="googlebot" content="noindex,noarchive,nofollow" />
<meta name="googlebot" content="noimageindex" />
<meta name="googlebot" content="noimageindex" />tells googlebot not to include your images in Google Images Search results not to use your site as a referring page. Note: images on the page may still be included in the image index if they are linked to by other pages.
<meta name="googlebot" content="noimageindex" />
<meta name="msnbot" content="noindex,nofollow" />
Tells MSNbot not to index your page content and not to follow your links.
<meta name="msnbot" content="noindex,nofollow" />
<meta name="robots" content="noydir" />
Tell all bots not to use a Yahoo! Directory title or Yahoo! Directory description.
<meta name="robots" content="noydir" />
<meta name="slurp" content="noydir" />
Specifically tell Yahoo! bot name="slurp" to not crawl your page.
<meta name="slurp" content="noydir" />