Build a page-level <meta name="robots"> tag to control whether search engines index a specific page and follow its links.
Build a page-level <meta name="robots"> tag to control how search engines index and crawl an individual page.