Skip to main content

Robots.txt

A file that tells crawlers which sections of your site to avoid.

Why this matters

Incorrect rules can block important pages from being crawled.

Quick tip

Double-check that key service, product, and blog pages are not disallowed.

Frequently asked questions

What does Robots.txt mean in simple terms?

A file that tells crawlers which sections of your site to avoid.

Why does Robots.txt matter for SEO?

Incorrect rules can block important pages from being crawled.