A large-scale, commercially licensed reference database of verified page-type URLs used to govern what autonomous web agents may open. Coverage is 40 million plus domains, each carrying up to 28 page-type URL pairs - login, signup, checkout, cart, pricing, blog, documentation and others - where every URL is verified against the domain's live link structure rather than inferred from a path pattern, built from analysis of more than 10 billion links. Absence is recorded explicitly, so a consumer can distinguish a verified-absent checkout URL from one never checked. Each domain also carries a four-tier IAB v2 and four-tier IAB v3 content classification from a 700-plus category taxonomy, a classification from a 59-category web-filtering taxonomy, a detected primary language, roughly 40 method-aware URL-pattern rules, and a High-Value Host List of infrastructure hosts denied by default. Sold two ways: a per-URL lookup API returning allow, deny or flag verdicts, and a one-time on-premise database licence for local lookup.
Equities in Europe, US. Related tickers AMZN, SHOP, SE, BKNG, UBER, CHTR, NET.
Tabular + API - a flat CSV/JSON/SQL database dump keyed on registrable domain with 17 top-level columns and a nested page-type map, plus a per-URL lookup API returning verdict, matching rule layer and the domain's full page-type map; official clients on npm, PyPI, Packagist and crates
Stated scope: 40 million plus domains, up to 28 verified page-type URLs each, derived from analysis of more than 10 billion links, so on the order of hundreds of millions of verified URL-to-page-type assertions; plus 700-plus IAB content categories and 59 web-filtering categories per domain, about 40 method-aware URL-pattern rules, and a High-Value Host List of roughly 60 infrastructure hosts. A sibling product from the same operator extends the underlying domain-intelligence base to 120 million domains. This is the largest dataset in this cluster by an order of magnitude.
Free labels at reference scale: a per-domain page-type presence label across 28 functional surface types, each verified from live link structure rather than guessed, giving a trustworthy ground-truth map of where credential-bearing and transactional pages actually sit on the web; an explicit negative label where a page type is verified absent, which is the rarer and more valuable half and the thing that makes automated allowlisting safe; a dual-taxonomy content classification producing eight IAB tier labels per domain in both v2 and v3 simultaneously, which also encodes a v2-to-v3 mapping; a separate 59-way web-filtering safety classification; a detected primary language label; and a per-URL verdict label (allow, deny or flag) conditioned on HTTP method, which is method-aware policy rather than a static list.
AI Agent Allowlist (Alpha Quantum, Munich) — A large-scale, commercially licensed reference database of verified page-type URLs used to govern what autonomous web agents may open. Coverage is 40 million plus domains, each carrying up to 28 page-type URL pairs - login, signup, checkout, cart, pricing, blog, documentation and others - where every URL is verified against the domain's live link structure rather than inferred from a path pattern, built from analysis of more than 10 billion links. Absence is recorded explicitly, so a consumer can distinguish a verified-absent checkout URL from one …
Not yet on file: Sample · Data dictionary · Data frequency · Reporting lag · Point-in-time · License