Attributed bot / AI-agent web-traffic logs

Name: Attributed bot / AI-agent web-traffic logs: per-request records identifying which of 2,000+ known crawlers, scrapers and AI agents visited which page, when, and with what outcome (error, redirect, blocked), plus spoof-verification flags
Creator: Known Agents

KNOWN AGENTSManage supplier listing

Attributed bot / AI-agent web-traffic logs: per-request records identifying which of 2,000+ known crawlers, scrapers and AI agents visited which page, when, and with what outcome (error, redirect, blocked), plus spoof-verification flags

Open buyer room →

Sample

Brickroad customers

Sample this dataset before you buy it.

Your sourcing agent asks Known Agents and files the sample in your catalog — private to you.

Start 7-day trialNothing is charged until the trial ends.

Coverage

Universe, instruments and categories.

Industry: Application Software
Instruments: equities
Categories: AlternativeReferenceSentiment

Dataset card

Type: not stated
Format: Tabular (request-level event logs / time series), with a curated categorical agent taxonomy
Volume: Potentially billions of agent-visit events cumulatively — the page claims half of web visitors are bots/agents, so an instrumented mid-size retail site alone can emit millions of classified agent requests per month; the vendor's own 2,000+ agent reference directory is a fixed ~2,000-row labeled entity table
Users: ~50-500 customer sites (inferred: 1-person New York startup in early GTM; seat count not published)
History: 2 years
Update frequency: not stated
Growth: Active — newly launched product with a live agent directory, marketing insights hub and multiple product pages (Agent Analytics, Agentic Commerce Optimization) shipped
Launched: not stated
Delivery: not stated
Entity mapping: not stated
Sample: not stated
Point-in-time: not stated
Licence: not stated

supplier index read from their site