What is crawl budget?

Answer

Crawl budget is the number of pages a crawler can fetch within time and resource constraints. It is limited by your crawler capacity and by how much load the target site can handle. Budgets help keep crawling predictable and prevent overloading servers. They also prioritize which pages matter most for your use case. A good budget considers page importance, update frequency, and error rates. Tuning the budget improves coverage without causing blocks.