Robots meta element in markup

<meta name="robots" content="noindex,nofollow" />

• name="robots"
• content
  • index or noindex
  • follow or nofollow
  • noarchive
  • none
  • all

The Robots meta element can be used on a per document basis.

HTTP Header: X-Robots-Tag

• Google: Robots meta tag and X-Robots-Tag

• index — index the page
• noindex — don't index the page
• follow — follow links from the page
• nosnippet — don't display descriptions or cached links
• nofollow — don't follow links from the page
• noarchive — don't cache/archive the page
• none — do nothing, ignore the page
• all — do whatever you want, default behavior