Skip to main content

Although the crawl scope is set to "only this directory", other directories in the domain are also crawled

Benjamin Weßel avatar
Written by Benjamin Weßel
Updated over 3 weeks ago

Symptoms

  • The crawl scope of an onpage analysis is set to "this directory only"

  • directories other than the one specified in the start URL are also crawled.
    For example, domain.tld/en/ was specified, but the directory domain.tld/en/ is also crawled

Cause

The page source text of the start URL specified in the onpage analysis contains a canonical link without a closing slash ( / ).

Solution

Change the canonical link so that it contains a trailing slash.

Did this answer your question?