Throughput · last 24 h
–
–pages fetched
–
24 h ago12 h agonow
updates every minute
Crawler status
What SyntoraDataBot is doing right now. Aggregate numbers only: no site or person is listed here.
- Crawler: one server in Falkenstein, Germany
- Arcs: pages being fetched now; blue land = websites visited in that country
- Pins: height grows with the pages fetched in the country
- Amber arcs: failed requests, at the live error rate
- Grey land: not crawled
Right now
–
–
- Last request
- –
- Gap per site
- ≥ 5 s
Response mix · 24 h
–
Coverage
–
Facts found on company websites
–
Company facts: switchboards, general inboxes, addresses, VAT numbers, company profiles, each with its page and date. Work contacts are counted separately and are not shown to anyone.
Verified websites
–company websites
Queue
–pages waiting
–
Homepage first, then linked company pages: at most 25 per site, two links deep.
Politeness, measured
How to slow or block it →–URLs skipped because robots.txt said no
–sites that asked for a slower pace, and got it
–sites paused for 7 days after repeated errors
2 MBpage cap, text/html only, 25 pages per site
Identity: SyntoraDataBot/0.2 from 162.55.129.55 (crawler.syntoradata.com); back-off on 429 / 5xx / timeouts.