KWT Spider Logo
Crawl &Configuration

Crawl engines:Fast vs Stable

Choose the engine that fits your crawl size and stability needs.

Fast engine

Async engine for quicker crawls. Best for smaller to medium sites when you want results fast.

Stable engine

Threaded engine that may be more reliable on very large or slow-responding sites. Use for deep crawls if you see timeouts.

When to switch

If a crawl often fails or times out,try the Stable engine. For most audits,Fast is sufficient.