Fail

robots.txt blocks Googlebot from this page

The short version

Allow the page in robots.txt.

What it means

Your robots.txt has a rule that stops Googlebot from crawling this page. The detail shows the rule and its line number, such as Disallow: / on line 2. We read the rules the way Google does: the group for Googlebot if there is one, else the group for all crawlers, and the longest matching rule wins.

Why it matters

A page that crawlers can't fetch can't be read. Google may still list the bare address if other sites link to it, but without a title or description, and it won't rank for its content. A single stray Disallow: / hides a whole site.

How to fix it

  1. Open /robots.txt on your site and find the line the detail names.
  2. Remove the rule, or narrow it so it covers only what you want hidden, such as Disallow: /admin/.
  3. If you need an exception inside a blocked folder, add a more specific Allow: line for it.
  4. Don't use robots.txt to keep a page out of search: use noindex on a page crawlers can fetch.
  5. Save the file and make sure it answers 200 as plain text.

Check it worked

Run the SEO audit again on the same address. The finding should be gone and the grade should rise.