Skip to main content

Why does the onpage analysis take so long?

Onpage analysis is very slow, why?

Benjamin Weßel avatar
Written by Benjamin Weßel
Updated yesterday

Question

Why does the onpage analysis take so long?

Answer

  1. The crawl delay can be set for each onpage analysis in the advanced settings of an onpage analysis. This is the time that the crawler "sleeps" after each page request.

  2. The Crawl-delay property can also be set in Robots.txt - this has the same effect as described in point 1, except that this works for all XOVI crawls (provided it is set for the correct user agent).

Did this answer your question?