Aiagentallowlist

AIAGENTALLOWLISTManage supplier listing

A large-scale, commercially licensed reference database of verified page-type URLs used to govern what autonomous web agents may open. Coverage is 40 million plus domains, each carrying up to 28 page-type URL pairs - login, signup, checkout, cart, pricing, blog, documentation and others - where every URL is verified against the domain's live link structure rather than inferred from a path pattern, built from analysis of more than 10 billion links. Absence is recorded explicitly, so a consumer can distinguish a verified-absent checkout URL from one never checked. Each domain also carries a four-tier IAB v2 and four-tier IAB v3 content classification from a 700-plus category taxonomy, a classification from a 59-category web-filtering taxonomy, a detected primary language, roughly 40 method-aware URL-pattern rules, and a High-Value Host List of infrastructure hosts denied by default. Sold two ways: a per-URL lookup API returning allow, deny or flag verdicts, and a one-time on-premise database licence for local lookup.