Crawl frequency reporting shows how often Baiduspider visits and what it encountered; crawl diagnosis lets you fetch a URL as the spider.
What to watch
- Crawl volume dropping without a site change usually indicates a server or availability problem.
- Crawl exceptions grouped by type, not by URL.
- Whether the spider receives the same content a browser does.
The lever you have
Server response time. Baidu crawls faster sites more, which is one of the more direct performance-to-indexing links in any engine.
Alien Road
How we apply this
For clients hosting outside mainland China this report usually tells the whole story: crawl volume is low because latency is high, and the fix is infrastructure rather than anything on the page.
Related services