Skip to content
Both AI-scribe papers are accepted at NeurIPS 2026 workshops: the census and the omission-blindness judge paper
Benchmarks and training environments

Environments

Realistic worlds built from code, where the right answer is known before an agent starts. Each world yields a series of environments, one professional job with its own grader, and the tasks in a series are generated from seeds.

Seeded organisation

DataRoomBench

Realistic company data rooms, built from code so the right answer is known before any agent starts.

  1. Environment

    Incident Report

    The customer side of a bad incident: the report, the service credits, and a letter to each customer owed one.

Coming soon

More environments on the same construction.

  • Operations Report

    The quarter's figures and disclosures for the board, from the same company's records under its own reporting policy.

  • Clinical Incident Review

    A hospital's records around a patient-safety incident, with the review as the job and the hospital's own policy as the rule to apply.

  • Trial Operations

    A clinical trial's sites, source documents and safety desk: screening referrals against the protocol, monitoring sites, and the serious-adverse-event desk.

Simulated clinic

SimClinicBench

Coming soon

Simulated clinics on published physiology models. The agent is the clinician for a caseload of simulated patients over weeks; the causes of what it sees sit in no record, and the score is what happens to the patient, computed by the physiology with no judge in it.

  1. Environment · Coming soon

    GlucoseClinic

    The specialist nurse for a caseload of adults with type 1 diabetes on injections, over eight weeks: set each patient's insulin doses, phone them within a weekly budget of nurse time, give advice, and find the causes of glucose change that only asking reveals. The task and its protocol were shaped with a diabetes specialist nurse.

Coming soon

More clinics, each on its own published physiology model.

  • Anticoagulation Clinic

    Warfarin dosing for a caseload over weeks, against a clotting measure that lags the dose by days.

  • Blood Pressure Clinic

    Home readings, adherence and hidden secondary causes over weeks, with the dose and the advice as the levers.

  • Ward Dosing

    Drugs dosed to a target blood level on a ward, where the level is measured late and the patient's state changes.

A third kind of world, built on the scientific record and its own later corrections, is in design.

Run an environment on your models

Talk to us about access

That includes early access to an environment marked coming soon.

Looking for our papers and open benchmarks? See our research.