SyntoraData
Request access

since 21 July 2026

Timeline

How SyntoraData was built, and what the crawler has done day by day. Charts update every hour; aggregate numbers only.

Days crawling

––

Pages fetched

–all time

Websites visited

–first successful fetch

Websites verified

–by company number or postcode

Pages fetched per day

Total pages fetched

–

Total websites verified

–

Milestones

  1. Crawler

    Going global

    The crawler opens to companies worldwide: websites from global identifier sets and licensed company datasets join the registers, and a public coverage page shows the numbers.

  2. Infrastructure

    Live status in public

    The status page shows the crawler live: pages per hour, errors, robots.txt skips and coverage by country.

  3. Sources

    Open registers from 7 countries

    Registers from seven European countries bring about 19 million companies, each under its open licence; GLEIF and Wikidata add global identifiers.

  4. Crawler

    Websites verified at scale

    A website counts as a company's only when the site shows its company number, or its name and registered postcode.

  5. Data

    Provenance end to end

    Source, page and date travel with every fact through search and bulk exports.

  6. Infrastructure

    Own server in Germany

    The crawler moves to a dedicated, fully encrypted server in Falkenstein (EU), with a fixed IP and reverse DNS.

  7. Privacy

    Privacy notice in six languages

    English, French, Finnish, Swedish, Norwegian and Latvian, for the countries whose company sites we read.

  8. Crawler

    SyntoraDataBot starts crawling

    A polite crawl of company websites: robots.txt honoured, at least 5 seconds between requests to a site, 25 pages per site. Every fact keeps the page and the date it came from.

  9. Data

    Records linked across sources

    Entity resolution links records for the same company across registers, without overwriting the originals.

  10. Crawler

    Website discovery begins

    Finding each company's own website from register data, with robots.txt checked for every site first.

  11. Sources

    INSEE Sirene (France) added

    France's register joins: 14.68 million active companies across the UK and France.

  12. Privacy

    Suppression list and data requests

    A suppression list every collection path checks, and a process to answer access and erasure requests.

  13. Sources

    Companies House added

    The UK's official company register becomes the first source, reused under the Open Government Licence.

  14. Data

    Clean records and search

    Register records are normalised and validated before anything is served, and become searchable.