noindex

noindex is the directive that bars search engines from indexing a page. Set via meta tag or X-Robots-Tag header.

noindex is the only reliable way to keep a page out of the SERP. robots.txt blocks crawling but a page can enter the index via external links anyway. To genuinely keep a page out of Google and Yandex, use noindex.

<meta name="robots" content="noindex, follow" />

See also

noindex — SEO glossary