airbench.ai

checkup · Qwen38_27b with opencode on a gx10

AI Doctor report

published · public

shareable · https://airbench.ai/aidoctor/checkup/97107392-1dec-4ad5-8dfd-ab54ba74b720

modelself-reportedqwen38-27b

started 2026-08-17 14:32 UTC · published 2026-08-17 20:31 UTC

overall

Answered 23 of 28 challenges; 22 correct.

pass rate among the 23 graded (of 28 total)

partial checkup · not every challenge has been answered

vitals

time to last answer

342m 7s

late

23

errors

0

answered

82%

systems

Brain — reasoning & discipline

5/5 passed · 5 unanswered

10 challenges
challengeanswerverdictscoretime

letter-count-1

How many times does the letter "r" appear in "rennrrixren"? Answer with just the number.

answer hidden on published runs
pass
117m 49s

decimal-compare-1

Which decimal number is larger, 4.3 or 4.96? Answer with just the larger number.

answer hidden on published runs
pass
12m 22s

arithmetic-1

Compute step by step, left to right (no operator precedence): 49 * 6 - 11 + 12 * 9. Answer with just the final number.

answer hidden on published runs
pass
1batched

unit-convert-1

Convert 16 kg to g. Now treat that resulting number as a fresh quantity of kg and convert it to g (1 kg = 1000 g). Answer with just the final integer number of g.

answer hidden on published runs
pass
1batched

format-json-1

Reply with ONLY a JSON object, no other text. The object must have exactly two keys, in this order: "answer" then "checksum". "answer" must be the string "3205". "checksum" must be a JSON number (not a string) equal to the sum of the digits of 3205. Example shape: {"answer":"1234","checksum":10}

answer hidden on published runs
pass
1batched

math-add-1

not answered

math-sum-1

not answered

math-expression-1

not answered

math-determinant-1

not answered

math-compute-1

not answered

Eyes — vision

7/8 passed

  • · Read text at every size tested (down to 8px).
8 challenges
challengeanswerverdictscoretime

acuity-20

Look at the image at (fetch it and view it). This is an eye chart with 7 numbered rows, each containing 3 groups of 5 characters. Read row 4, group 3 (groups are numbered left to right). What are the 5 characters, in order? Answer with just the 5-character code, e.g. AB3XZ.

answer hidden on published runs
pass
183m 37s

acuity-14

Look at the image at (fetch it and view it). This is an eye chart with 7 numbered rows, each containing 3 groups of 5 characters. Read row 5, group 2 (groups are numbered left to right). What are the 5 characters, in order? Answer with just the 5-character code, e.g. AB3XZ.

answer hidden on published runs
pass
1batched

acuity-10

Look at the image at (fetch it and view it). This is an eye chart with 7 numbered rows, each containing 3 groups of 5 characters. Read row 6, group 2 (groups are numbered left to right). What are the 5 characters, in order? Answer with just the 5-character code, e.g. AB3XZ.

answer hidden on published runs
pass
1batched

acuity-8

Look at the image at (fetch it and view it). This is an eye chart with 7 numbered rows, each containing 3 groups of 5 characters. Read row 7, group 3 (groups are numbered left to right). What are the 5 characters, in order? Answer with just the 5-character code, e.g. AB3XZ.

answer hidden on published runs
pass
1batched

count-1

Look at the image at (fetch it and view it). How many purple diamonds are in the image? Answer with just the number.

answer hidden on published runs
pass
1batched

spatial-1

Look at the image at (fetch it and view it). Which cell contains the red circle? Answer as: row R, column C (1-indexed from top-left). Answer as: row R, column C.

answer hidden on published runs
fail

expected row 4, column 1, got "row 5, column 1"

0batched

chart-1

Look at the image at (fetch it and view it). Using the "Support Tickets Opened" chart, approximately what value did Aug have? Read it off the y-axis; answers within +/-5 are accepted.

answer hidden on published runs
pass
1batched

screenshot-1

Look at the image at (fetch it and view it). What is the total amount shown in the cart panel? Answer with just the total amount, e.g. $12.34.

answer hidden on published runs
pass
1batched

Reading — mail

6/6 passed

6 challenges
challengeanswerverdictscoretime

aggregate-1

You are examining a mailbox: Phillip Allen's mail at enronmail.airbench.ai How many messages in the mailbox are dated during March 2001? Answer with just the number.

answer hidden on published runs
pass
1267m 42s

aggregate-2

You are examining a mailbox: Phillip Allen's mail at enronmail.airbench.ai How many messages are marked unread in the inbox folder? Answer with just the number.

answer hidden on published runs
pass
1batched

temporal-1

You are examining a mailbox: Phillip Allen's mail at enronmail.airbench.ai What is the subject of the oldest message in the archive folder? Answer with just the subject line, exactly as shown.

answer hidden on published runs
pass
1batched

temporal-2

You are examining a mailbox: Phillip Allen's mail at enronmail.airbench.ai What is the subject of the oldest message carrying the label "travel"? Answer with just the subject line, exactly as shown.

answer hidden on published runs
pass
1batched

needle-1

You are examining a mailbox: Phillip Allen's mail at enronmail.airbench.ai In the message with the subject "FW: Curve Shift File", what dollar amount is called out as the biggest difference between actual and theoretical curve shift? Answer with just the exact fact as it appears in the message, and nothing else.

answer hidden on published runs
pass
1batched

needle-2

You are examining a mailbox: Phillip Allen's mail at enronmail.airbench.ai In Phillip's reply about Bob Huntley's request for a survey of the lot, what fax number does Bob give for receiving faxed documents? Answer with just the exact fact as it appears in the message, and nothing else.

answer hidden on published runs
pass
1batched

Hands — web agency

4/4 passed

  • · purchase-1 — store events recorded for this order's session: checkout_result (recorded by the store; not verified as agent-driven).
  • · recover-decline-1 — store events recorded for this order's session: checkout_result (recorded by the store; not verified as agent-driven).
4 challenges
challengeanswerverdictscoretime

find-product-1

The store is at abostore.airbench.ai Among products in the **Toys & Games** category priced at or above **$50** with a rating of at least **3.5**, which has the **lowest price**? The search space is every product in the store's catalog. Answer with just that product's id (the amazon.xx:B0… form).

answer hidden on published runs
pass
1342m 5s

find-product-2

The store is at abostore.airbench.ai Among products in the **Sports & Outdoors** category priced under **$650** with a rating of at least **3.6**, which has the **lowest price**? The search space is every product in the store's catalog. Answer with just that product's id (the amazon.xx:B0… form).

answer hidden on published runs
pass
1batched

purchase-1

The store is at abostore.airbench.ai Buy exactly 1 unit of AmazonBasics Foaming Soap Pump Dispenser - Nickel (product id amazon.ca:B07FFSKBKW, abostore.airbench.ai/product/amazonbasics-foaming-soa…) on abostore, completing checkout with a valid payment method. Use the checkout email aidoctor-a4f10e5d@aidoctor.test. Answer with just the resulting order id.

answer hidden on published runs
pass

trace:checkout_result

1batched

recover-decline-1

The store is at abostore.airbench.ai Buy exactly 2 units of Amazon Basics Cat Tower Medium Gray Scratch Post 16.1 x 16.1 x 31.9 inches (41 x 41 x 8 (product id amazon.co.jp:B07G3GVBV7, abostore.airbench.ai/product/amazon-basics-cat-tower-…) on abostore. First attempt checkout with a card number ending in 0000 — this payment will be declined. Then retry checkout with a different, valid card and complete the purchase successfully. Use the same checkout email aidoctor-5374467b@aidoctor.test for both attempts. Answer with just the order id of the successful (approved) order.

answer hidden on published runs
pass

trace:checkout_result

1batched