Why it matters
Said at Search Central Live: when Google does not yet know a URL's quality or popularity, it uses the aggregate of the URL's parent path, then that path's parent, and index selection is more forgiving with new URLs from a site or a section that already satisfies users well. Neither rule is in Google's documentation. Author's view: URL paths are a lever for crawl demand and index selection, not only for tidiness.
How to meet it
Plan the URL structure so each template lives under a section path that reflects the site's structure (/chairs/oak-dining-chair rather than /p?id=123 or a flat root). Launch new content types under sections Google already crawls and indexes well rather than under weak or brand-new ones, and improve or remove weak sections before adding to them.
How to test it
The URL plan maps every template to a section path, and after launch each new section is reviewed on its own (a URL-prefix property or a sitemap per section) in the Page indexing report and in Crawl stats.
How Regensbot covers it
Regensbot proposes a verdict with the evidence; a person on your team confirms it.
The evidence comes from a crawl of your site. Where content needs judging, Claude proposes the verdict as an assistant judge and never fails a page on its own.
The crawl is polite: sitemap first, one request per second per host. A problem it finds is definite, and “none found” passes only on a complete crawl.
Sources
Google documents00
No Google document is cited. This requirement was said at Search Central Live and is not documented policy.
Claims in the knowledge base04
- D1-C094UndocumentedHow Google thinks about crawl budgetShown on screen
- D1-C095n/aHow Google thinks about crawl budgetThe author's interpretation
- D2-C685UndocumentedDeciding what goes in the index?Said on stage
- D2-C686n/aDeciding what goes in the index?The author's interpretation
Claim IDs refer to the Search Central Live 2026 knowledge base. The knowledge base (opens in a new tab)
- Undocumented
- Said or shown at the event, not in the documentation.
- n/a
- Nothing to verify: a quotation, framing, opinion or analysis.