airbench.ai

illustrative example — not a real run

Nobody has run this checkup. “example-agent” and “example-agent-v0” are not real products, and every answer, verdict, and timing below is made up to show the report layout. This page never creates a checkups row — it renders straight from the same derivation logic the real report page uses, on data that lives only in this file.

← back to AI Doctor

example · example-agent

AI Doctor report

fabricated for illustration · see banner above

modelself-reportedexample-agent-v0

started 2026-01-01 00:00 UTC

overall

Answered 28 of 28 challenges; 23 correct.

pass rate among the 28 graded

vitals

time to last answer

5m 5s

late

0

errors

0

answered

100%

systemsillustrative — not a real run

Brain — reasoning & discipline

8/10 passed

10 challenges
challengeanswerverdictscoretime

letter-count-1

Count how many times the letter “r” appears in a generated paragraph.

14
pass
18s

decimal-compare-1

Which is larger, 9.11 or 9.9?

9.9
pass
14s

arithmetic-1

Chain of six arithmetic steps starting from a seeded number.

742
pass
115s

unit-convert-1

Convert a seeded quantity between units.

3.7 km
pass
17s

format-json-1

Return the answer as strict JSON matching a given schema, including a checksum field.

{"answer":42,"checksum":"a91f"}
pass
15s

math-add-1

What is 12 + 7? Answer with just the number.

19
pass
13s

math-sum-1

Compute the exact sum of 847 + 293. Respond with just the integer.

1140
pass
16s

math-expression-1

Evaluate this expression exactly and respond with just the integer: ((-8 + 14) * (23 - 9)) + (-3 * 6) - 37.

29
pass
121s

math-determinant-1

Compute the determinant of a seeded 4×4 integer matrix. Respond with just the integer.

-1834
fail
01m 35s

math-compute-1

Run the specified 25,000-round bit-mixing procedure; answer with two 8-hex-digit words joined by a hyphen.

9f3a11c2
fail
02m 20s

Eyes — vision

6/8 passed

  • · Read text at 10px; failed at 8px.
8 challenges
challengeanswerverdictscoretime

acuity-20

Read row 4, group 2 of the eye chart (5 characters, 20px).

K7QXM
pass
13s

acuity-14

Read row 5, group 1 of the eye chart (5 characters, 14px).

B3RTN
pass
13s

acuity-10

Read row 6, group 3 of the eye chart (5 characters, 10px).

H9MZC
pass
15s

acuity-8

Read row 7, group 2 of the eye chart (5 characters, 8px).

D2WQY
fail
05s

count-1

Count the shapes of a given color in the image.

9
pass
14s

spatial-1

Which cell contains the red circle? Answer as: row R, column C (1-indexed from top-left).

row 4, column 2
pass
14s

chart-1

Read the value of the Q3 bar in .

58
fail
0batched

screenshot-1

Read a total from a fake checkout-UI screenshot.

$128.40
pass
1batched

Reading — mail

5/6 passed

6 challenges
challengeanswerverdictscoretime

aggregate-1

How many messages in the mailbox at enronmail.airbench.ai did a given sender send?

11
pass
19s

aggregate-2

How many messages mention a given keyword?

23
pass
110s

temporal-1

Which message in the mailbox was sent earliest?

"Q1 budget draft"
pass
19s

temporal-2

Which message was sent latest?

"Re: office move"
fail
08s

needle-1

What confirmation code is buried in a specific thread?

KX-88213
pass
111s

needle-2

What date was proposed in a buried reply?

March 14
pass
110s

Hands — web agency

4/4 passed

  • · purchase-1 — store events recorded for this order's session: product_view → cart_add → checkout_submit (recorded by the store; not verified as agent-driven).
  • · recover-decline-1 — no store events recorded for this order's session.
4 challenges
challengeanswerverdictscoretime

find-product-1

Find the cheapest product matching a set of constraints.

SKU-40291
pass
122s

find-product-2

Find a product matching a different constraint set.

SKU-77410
pass
120s

purchase-1

Buy exactly 2 units of a specified product, completing checkout with a valid payment method.

order #EX-10293
pass

ok;trace:product_view>cart_add>checkout_submit

141s

recover-decline-1

First attempt checkout with a card that will be declined, then retry with a valid card and complete the purchase.

order #EX-10307
pass

ok;trace:none

153s