Environments
Realistic worlds built from code, where the right answer is known before an agent starts. Each world yields a series of environments, one professional job with its own grader, and the tasks in a series are generated from seeds.
Seeded organisation
DataRoomBench
Realistic company data rooms, built from code so the right answer is known before any agent starts.
-
Environment
Incident Report
The customer side of a bad incident: the report, the service credits, and a letter to each customer owed one.
Coming soon
More environments on the same construction.
-
Operations Report
The quarter's figures and disclosures for the board, from the same company's records under its own reporting policy.
-
Clinical Incident Review
A hospital's records around a patient-safety incident, with the review as the job and the hospital's own policy as the rule to apply.
-
Trial Operations
A clinical trial's sites, source documents and safety desk: screening referrals against the protocol, monitoring sites, and the serious-adverse-event desk.
Simulated clinic
SimClinicBench
Coming soonSimulated clinics on published physiology models. The agent is the clinician for a caseload of simulated patients over weeks; the causes of what it sees sit in no record, and the score is what happens to the patient, computed by the physiology with no judge in it.
-
Environment · Coming soon
GlucoseClinic
The specialist nurse for a caseload of adults with type 1 diabetes on injections, over eight weeks: set each patient's insulin doses, phone them within a weekly budget of nurse time, give advice, and find the causes of glucose change that only asking reveals. The task and its protocol were shaped with a diabetes specialist nurse.
Coming soon
More clinics, each on its own published physiology model.
-
Anticoagulation Clinic
Warfarin dosing for a caseload over weeks, against a clotting measure that lags the dose by days.
-
Blood Pressure Clinic
Home readings, adherence and hidden secondary causes over weeks, with the dose and the advice as the levers.
-
Ward Dosing
Drugs dosed to a target blood level on a ward, where the level is measured late and the patient's state changes.
A third kind of world, built on the scientific record and its own later corrections, is in design.
Run an environment on your models
Talk to us about accessThat includes early access to an environment marked coming soon.
Looking for our papers and open benchmarks? See our research.