Skip to main content

Although the crawl scope is set to "only this directory", other directories in the domain are also crawled

Written by Benjamin Weßel
Updated over 6 months ago

Symptoms

  • The crawl scope of an onpage analysis is set to "this directory only"

  • directories other than the one specified in the start URL are also crawled.
    For example, domain.tld/en/ was specified, but the directory domain.tld/en/ is also crawled

Cause

The page source text of the start URL specified in the onpage analysis contains a canonical link without a closing slash ( / ).

Solution

Change the canonical link so that it contains a trailing slash.

Did this answer your question?