Botective

A commercially sold, machine-readable bot and crawler identification dataset: JSON profiles for 171 named bots and crawlers, each record carrying the bot name, the owning provider, its published IP ranges/CIDR blocks, and its user-agent strings (example records on the page show Bingbot mapped to Microsoft with two CIDR blocks and two user-agents, GPTBot mapped to OpenAI likewise). 8,766 IP addresses are tracked in total, though only 36% of bot entries carry IP data. Delivered as a static botective.json file with a redacted demo file, plus a changelog of updates. The company states the entries are sourced directly from the operators' official documentation.

Open buyer room →

Sample

Brickroad customers

Sample this dataset before you buy it.

Your sourcing agent asks Botective and files the sample in your catalog — private to you.

Start 7-day trialNothing is charged until the trial ends.

Coverage

Universe, instruments and categories.

Industry: Application Software
Instruments: equities
Categories: ReferenceAlternative

Dataset card

Type: not stated
Format: JSON - flat structured records (name, provider, ip_ranges array, user_agents array), one file, download-and-own delivery; a client-side log analyser demo is built on the same data
Volume: Stated on the page: 171 bot records, 8,766 IP addresses tracked, 36% of bot entries carrying IP data (so roughly 61 with ranges and roughly 110 user-agent-only); approximately 8.8K CIDR or IP entries total. This is a small, hand-curated reference table, not a large corpus.
Users: N/A - no registered-user base; the dataset is sold as a one-time $99 download with no account system or subscription described on the page
History: 2 years
Update frequency: not stated
Growth: Active but micro - the dataset carries a 'Last updated May 17, 2026' stamp with a public changelog, and the page cites 'billions of requests a day' from AI bots as the demand driver, indicating the AI-crawler entries are a recent addition. Copyright footer is 2025, so the whole property is about a year old. No team, funding or customer disclosure at all.
Delivery: not stated
Entity mapping: not stated
Sample: not stated
Point-in-time: not stated
Licence: not stated

supplier index read from their site