Skip to main content
SEO

Robots policy

Robots policy is a report term used to explain the robots.txt and bot directive rules that tell crawlers which paths they may fetch. It helps users understand the evidence behind a score or recommendation without reading implementation details.

Robots policy is a report term used to explain the robots.txt and bot directive rules that tell crawlers which paths they may fetch. It helps users understand the evidence behind a score or recommendation without reading implementation details.

In the report, use this item as evidence. Do not treat it as a standalone rule unless the surrounding page context supports the same conclusion.

How to interpret it

  • Understand what "Robots policy" means in the report UI.
  • Decide whether the item is a scoring input, evidence row, module label, or navigation state.
  • Connect the label to the related SEO or GEO concept before deciding what to fix.

Related articles

Image alt coverage

The share of images with text alternatives that explain visual content.

Form labels and accessible names

How inputs, selects, textareas, and custom controls get a visible or programmatic name for assistive technology and automated checks.

Document semantics and landmarks

How the page exposes structure—landmarks, main content, headings, and regions—so assistive technology can navigate and parse the document.