LLM/agent evaluation stack: metered evaluator API

Name: LLM/agent evaluation stack: metered evaluator API (Lynx hallucination detector, GLIDER reasoning judge, Percival agent-failure debugger) plus published eval datasets/benchmarks (FinanceBench 10,000 financial Q&A pairs, BLUR 573 tip-of-the-tongue pairs) and Digital World Models RL environments built on 1M+ world data artifacts from 5k+ expert contributors
Creator: Patronus AI

PATRONUS AIA3 · direct accessManage supplier listing

LLM/agent evaluation stack: metered evaluator API (Lynx hallucination detector, GLIDER reasoning judge, Percival agent-failure debugger) plus published eval datasets/benchmarks (FinanceBench 10,000 financial Q&A pairs, BLUR 573 tip-of-the-tongue pairs) and Digital World Models RL environments built on 1M+ world data artifacts from 5k+ expert contributors

Open buyer room →

Sample

Brickroad customers

Sample this dataset before you buy it.

Your sourcing agent asks Patronus AI and files the sample in your catalog — private to you.

Start 7-day trialNothing is charged until the trial ends.

Coverage

Universe, instruments and categories.

Industry: Application SoftwareInternet Services & Infrastructure
Categories: AI evaluation, guardrail and agent-training-environment platform (evaluator APIs + benchmark datasets)
Regions: US
Sample tickers: MSFTGOOGLAMZNNOWDDOGCRM

Patronus AI has not added their own details yet. Not yet on file:

Dataset
Data dictionary
Coverage
Provenance
Rights & data handling