Benchmark v1.0 · report
opencode/gx10/qwen3.5-122b-a10b-gptq-int4
sharedairbench.ai/checkup/cdc6ca60-d577-48e8-af32-92d3c2a09ccb/report
setup
- model type
- open model (local)
- GPU
- GX10
- harness
- opencode
- model
- qwen3.5-122b-a10b-gptq-int4
- VRAM
- not given
- RAM
- not given
- inference engine
- not given
- model link
- not given
modelself-reportedgx10/qwen35-122b
started 2026-09-19 21:19 UTC · shared 2026-11-16 21:58 UTC
overall
Answered 9 of 49 challenges; 9 correct.
9 of 49 challenges passed
partial run · 40 unanswered, counted against the score
- 9 passed
- 40 not answered
vitals
time
4m 41s
answered
18%
failed
0%
success
18%
systems
Math test
9/9 passed
letter-count-1✓ pass2m 48s
prompt
How many times does the letter "e" appear in "baszaeenpeel"? Answer with just the number.answer
answer hidden on shared reportsdecimal-compare-1✓ pass12s
prompt
Which decimal number is larger, 5.42 or 5.5? Answer with just the larger number.answer
answer hidden on shared reportsarithmetic-1✓ pass12s
prompt
Compute step by step, left to right (no operator precedence): 18 / 9 / 2 * 9 / 9. Answer with just the final number.answer
answer hidden on shared reportsunit-convert-1✓ pass12s
prompt
Convert 14 km to m. Now treat that resulting number as a fresh quantity of kg and convert it to g (1 kg = 1000 g). Answer with just the final integer number of g.answer
answer hidden on shared reportsformat-json-1✓ pass13s
prompt
Reply with ONLY a JSON object, no other text. The object must have exactly two keys, in this order: "answer" then "checksum". "answer" must be the string "2070". "checksum" must be a JSON number (not a string) equal to the sum of the digits of 2070. Example shape: {"answer":"1234","checksum":10}answer
answer hidden on shared reportsmath-add-1✓ pass12s
prompt
What is 8 + 8? Answer with just the number.answer
answer hidden on shared reportsmath-sum-1✓ pass12s
prompt
Compute the exact sum of 909 + 364. Respond with just the integer.answer
answer hidden on shared reportsmath-expression-1✓ pass12s
prompt
Evaluate this expression exactly and respond with just the integer: ((19 + -5) * (13 - 30)) + (-1 * -9) - 27answer
answer hidden on shared reportsmath-determinant-1✓ pass29s
prompt
Compute the exact determinant of this 4x4 matrix. Respond with just the integer. [-4, -3, -6, 7] [1, 1, 0, 4] [2, 7, 13, 2] [7, -6, 7, -4]answer
answer hidden on shared reports
Vision test
not examined · 0/19 answered
acuity-20— unanswered—
prompt
Look at the image at agentcheckup.ai/i/3014666584150813c771ec1303e02ca0.png (fetch it and view it). This is an eye chart with 7 numbered rows, each containing 3 groups of 5 characters. Read row 4, group 2 (groups are numbered left to right). What are the 5 characters, in order? Answer with just the 5-character code, e.g. AB3XZ.acuity-14— unanswered—
prompt
Look at the image at agentcheckup.ai/i/5f6f50c120b8ab4de1800e1e2739cb44.png (fetch it and view it). This is an eye chart with 7 numbered rows, each containing 3 groups of 5 characters. Read row 5, group 1 (groups are numbered left to right). What are the 5 characters, in order? Answer with just the 5-character code, e.g. AB3XZ.acuity-10— unanswered—
prompt
Look at the image at agentcheckup.ai/i/6256e3ee126290e7b07155624ba93e92.png (fetch it and view it). This is an eye chart with 7 numbered rows, each containing 3 groups of 5 characters. Read row 6, group 2 (groups are numbered left to right). What are the 5 characters, in order? Answer with just the 5-character code, e.g. AB3XZ.acuity-8— unanswered—
prompt
Look at the image at agentcheckup.ai/i/0a2f080b532356ae0ca3b33010300fc5.png (fetch it and view it). This is an eye chart with 7 numbered rows, each containing 3 groups of 5 characters. Read row 7, group 2 (groups are numbered left to right). What are the 5 characters, in order? Answer with just the 5-character code, e.g. AB3XZ.count-simple— unanswered—
count-medium— unanswered—
count-complex— unanswered—
spatial-simple— unanswered—
spatial-medium— unanswered—
spatial-complex— unanswered—
chart-simple— unanswered—
chart-medium— unanswered—
chart-complex— unanswered—
screenshot-simple— unanswered—
screenshot-medium— unanswered—
screenshot-complex— unanswered—
diagram-simple— unanswered—
prompt
Look at the image at agentcheckup.ai/i/c3883a269cfdd217906b45ff74613eac.png (fetch it and view it). This diagram shows named boxes connected by arrows. Which box has an arrow pointing to "Falcon"? Answer with just the box name, e.g. Kettle.diagram-medium— unanswered—
prompt
Look at the image at agentcheckup.ai/i/0c8ae7506954c28fe023ab3ab611320e.png (fetch it and view it). This diagram shows named boxes connected by arrows. Which box has an arrow pointing to "Valley"? Answer with just the box name, e.g. Kettle.diagram-complex— unanswered—
prompt
Look at the image at agentcheckup.ai/i/fe12a7394b1dd04b7b5b5aa5966a1b19.png (fetch it and view it). This diagram shows named boxes connected by arrows. Which box has an arrow pointing to "Melon"? Answer with just the box name, e.g. Kettle.
Finding and reading email test
not examined · 0/6 answered
aggregate-1— unanswered—
prompt
You are examining a mailbox: Phillip Allen's mail at enronmail.airbench.ai How many messages carry the label "approvals"? Answer with just the number.aggregate-2— unanswered—
prompt
You are examining a mailbox: Phillip Allen's mail at enronmail.airbench.ai How many messages carry the label "legal"? Answer with just the number.temporal-1— unanswered—
prompt
You are examining a mailbox: Phillip Allen's mail at enronmail.airbench.ai What is the subject of the oldest message in the archive folder? Answer with just the subject line, exactly as shown.temporal-2— unanswered—
prompt
You are examining a mailbox: Phillip Allen's mail at enronmail.airbench.ai What is the subject of the newest message carrying the label "attachments"? Answer with just the subject line, exactly as shown.needle-1— unanswered—
prompt
You are examining a mailbox: Phillip Allen's mail at enronmail.airbench.ai In the message with the subject "FW: Mid C New deals Sept 24", what net value to book is given for the new deals? Answer with just the number.needle-2— unanswered—
prompt
You are examining a mailbox: Phillip Allen's mail at enronmail.airbench.ai In the message with the subject "FW: Zero Option", what dollar amount is given for the outstanding bill that will hit Enron in Q1 2002? Answer with just the number.
Purchasing test
not examined · 0/4 answered
find-product-1— unanswered—
prompt
The store is at abostore.airbench.ai Among products in the **General Merchandise** category priced under **$250** with a rating of at least **4.5**, which has the **lowest price**? The search space is every product in the store's catalog. Answer with just that product's id (the amazon.xx:B0… form).find-product-2— unanswered—
prompt
The store is at abostore.airbench.ai Among products in the **Fashion** category priced under **$150** with a rating of at least **4.5**, which has the **lowest price**? The search space is every product in the store's catalog. Answer with just that product's id (the amazon.xx:B0… form).purchase-1— unanswered—
prompt
The store is at abostore.airbench.ai Buy exactly 3 units of Moon and Back Baby Set of 4 Organic Cap and Mitten Sets (product id amazon.ca:B01M32UBJV, abostore.airbench.ai/product/moon-and-back-baby-set-o…) on abostore, completing checkout with a valid payment method. Use the checkout email aidoctor-4e4eb864@aidoctor.test. Answer with just the resulting order id.recover-decline-1— unanswered—
prompt
The store is at abostore.airbench.ai Buy exactly 2 units of AmazonBasics Putty Slime 4" Tin, Hypercolor - Green/Yellow, 3.2oz (product id amazon.co.uk:B07ZDQ271T, abostore.airbench.ai/product/amazonbasics-putty-slime…) on abostore. First attempt checkout with a card number ending in 0000 — this payment will be declined. Then retry checkout with a different, valid card and complete the purchase successfully. Use the same checkout email aidoctor-834b5e5f@aidoctor.test for both attempts. Answer with just the order id of the successful (approved) order.
Coding test
not examined · 0/11 answered
compute-hash-1— unanswered—
prompt
Write and run a short program to compute this exactly. Use unsigned 32-bit arithmetic modulo 2^32 throughout. Define rotl32(z, r) = ((z << r) | (z >> (32 - r))) mod 2^32, and let imul(a, b) mean 32-bit multiplication modulo 2^32. Start with data = [219866898, 927814331, 3539278520, 2006095897, 4252703534, 3102778503, 4201198068, 1757917061, 3264470154, 1750250643, 3671207024, 1718440753], x = 4097124134, y = 2857021151 and rounds = 25000. For each step from 0 to rounds - 1 apply: x = (imul(x XOR data[step % 12] XOR step, 2654435761) + rotl32(y, 5)) mod 2^32; y = (imul(y + data[(step + 7) % 12] + step, 1597334677) XOR rotl32(x, 11)) mod 2^32; x = (x + rotl32(y XOR step, 3)) mod 2^32. Return the final value as two lowercase 8-digit hex words joined by a hyphen, like 1a2b3c4d-55667788.compute-vm-1— unanswered—
prompt
Write and run a program to execute this tiny machine exactly. It has four registers a, b, c, d, all starting at 0, and a program counter starting at line 0. `set r n` sets r to n. `add r x`, `sub r x` and `mul r x` combine r with x (a register name or an integer), then reduce r modulo 1000003 into the range 0..1000002. `dec r` subtracts 1 from r. `jnz r k` jumps k lines (relative; k may be negative) if r is not 0. `halt` stops. Every other instruction moves to the next line. 0: set a 301 1: set b 8 2: set c 304 3: set d 482 4: add a 31 5: add a b 6: add a 72 7: dec d 8: jnz d -4 9: mul b 37 10: dec c 11: jnz c -8 12: halt Respond with just the final value of register a.compute-paths-1— unanswered—
prompt
Here is a grid of 25 rows and 25 columns. S is the top-left start, E is the bottom-right end, # is a wall and . is open. You may move up, down, left or right onto any non-wall cell. Find the length of the shortest path from S to E (the number of moves) and the number of distinct shortest paths modulo 1000000007. Write a program; this is not meant to be done by eye. S.............#....#..#.. #.##.#...#.....#......##. .#.##..##....#....#..##.. ..#............#.#.#..... .##......#..#.#...#..#.#. ..#..#...#..#...##.....#. .....#.#.#.#.#.....#.#... .#.........##..##.#.....# .......##........#....... .....##...#.#.#.#.#....#. .#...............#.....## ..#.#.....#...#....#.#... ...#....#.......##..##... ...#.##........#..#...... ....######.#..#....#..#.# #....##.#....#.........## .......##..##....#....... #....#..#.#....#.#.#..... #...##....#......##.....# ...#.#......##......#.##. #..#.....#.#.#.###.#....# ...#.#...#.#.#.#..#.#..#. .....#......#............ ...#..##....#..#.#....... #...#..#.#..........###.E Respond with the two integers separated by a space, like `52 1840`.compute-life-1— unanswered—
prompt
Simulate Conway's Game of Life on a 20x20 grid that wraps around at every edge (a torus). # is alive and . is dead. A live cell with 2 or 3 live neighbours (out of its 8) stays alive; a dead cell with exactly 3 live neighbours becomes alive; every other cell is dead in the next generation. Starting grid, row 0 first: .......##..#.#...... ....#.#....#.#..#... .......#..##....#.#. ....##.#.#.#..#.#.## .#....##.....###.... ........#....##...## .......##.##.####.## ...#.#.##.....#...## ..#####.#...#......# ##.##............... #......#.....#....#. .#.##..####.......#. ....#...#......#.... .#.................. #...#..##..#.#.#..#. ###...##.#.##.#..### #....##.##..#.....## .#...........#...### ##....#.#.#..#..#.#. #....##......#.#.... Run 150 generations. Report the number of live cells and the sum of row*20+column over all live cells (rows and columns numbered from 0). Respond as live:sum, like `37:7421`.compute-fibmod-1— unanswered—
prompt
Let F(0) = 0, F(1) = 1 and F(k) = F(k-1) + F(k-2). Compute F(n) mod m exactly for n = 7990028034709394 and m = 1299709. Respond with just the integer.compute-words-1— unanswered—
prompt
Below is a text. Words are separated by spaces. Ignore letter case, and strip any punctuation or quote characters attached to a word. Count how often each word occurs, then report the 3 most frequent words, most frequent first, breaking ties alphabetically. Respond exactly as word=count,word=count,word=count. renqui "quiti" "TITRU" Renvo vozan "ficnix" molu Ficzan shavo renvo! Titi. pelvo dorti motru MOLU titi shavo Titru. ficmo Renqui "renvo" renqui? MOLU! vomo renvo renqui. ficnix ficnix FICMO truzan renvo Pelvo basdor dorzan ficzan truzan renvo renvo tific lupel vozan ficfic TITRU motru, vomo basdor! sharen ficdor tific! molu Ficdor vomo ficmo? Renvo "basmo" quiti pelvo renvo "lupel" renqui, lupel molu renka BASDOR. dorti, DORZAN vozan dorzan renqui titi vozan renka RENKA vomo! shavo renvo ficren sharen KAMO lupel renvo VOZAN "quiti" vozan ficzan vozan Motru Vozan ficdor vomo titru renvo renvo shavo renqui shavo? ficren titi Molu vofic Renvo renqui tidor shavo titi titru; Ficfic ficzan ficnix dorzan quiti renqui Shabas renqui titru ficdor renvo tidor renvo vozan MOTRU quiti Ficzan ficmo quiti renka vofic; renqui tidor. renqui sharen lupel Renqui quiti Molu Renvo titru motru basdor shabas! vozan. pelvo. basdor. quiti ficdor Renqui ficnix sharen renqui tidor renqui TITRU Motru motru quiti renvo basdor ficfic vozan Renka molu Truzan molu renvo Basdor tidor "vozan" "kamo" Vomo motru motru dorzan "ficmo" titru Renvo renqui ficnix pelvo dorzan "Renqui" "molu" vozan Dorzan renqui vofic sharen tific renka; vomo Basdor Renqui. shavo ficren? tidor molu? RENKA tific basdor vozan Ficmo TITRU FICZAN renqui "vozan" ficren dorti Motru Renqui molu Tidor basmo tific molu renvo, Vomo TIFIC vozan "renqui" ficren vozan ficren renka. SHAREN vozan Titi, dorti Vofic dorzan ficdor Renvo Sharen dorzan dorzan quiti vofic Sharen sharen ficren lupel, "kamo" "motru" renqui titru Ficdor Shabas, Tidor pelvo kamo Kamo! ficzan, ficmo titru SHAREN; Vomo quiti Vomo vozan titru Renvo sharen Dorzan. motru motru tidor Dorzan shabas ficfic titru vozan Renqui. motru. vomo ficren tidor tidor? pelvo truzan Ficmo renvo renqui renqui vomo. RENQUI renqui renqui! kamo SHAREN "motru" titi lupel dorti renqui renka Titi "renvo" Motru sharen Renqui dorzan vofic vozan "renqui" ficdor truzan renqui molu Vozan vozan pelvo renka titi Sharen renvo ficmo molu renvo renqui vomo Vomo renka LUPEL motru renqui ficfic renka renqui; pelvo Basdor kamo renqui Renka Vomo renqui "sharen" lupel kamo Motru titru TITRU FICZAN renqui shavo Lupel titru BASMO; basmo Motru kamo "renqui" renvo; ficdor tific Titi molu "renqui" motru ficzan renqui renqui vofic; ficzan titru pelvo renqui "renqui" pelvo vomo, basmo Renvo vomo tidor Titi Vozan ficfic vozan renka; titru tidor motru sharen ficnix ficdor ficnix vozan Basmo kamo? Basdor Tific titi! pelvo vozan Tific lupel titru Ficdor! renqui titru renvo Sharen; titi, renvo Ficzan shavo Renqui truzan renvo tidor renqui Molu shabas? vozan Ficfic renqui sharen renqui renqui quiti. ficren quiti titrutrace-1— unanswered—
prompt
What exactly does this JavaScript program print? Respond with just the printed output. const v1 = ["1", "23", "11"].map(parseInt).join(","); const v2 = [80 / 6 | 0, Math.round(-1.5), -73 % 7].join(","); const v3 = [53, 6, 602, 1247].sort().join(","); const v4 = [null == 0, NaN === NaN, "80" < "9"].map(Number).join(""); console.log(v1, v2, v3, v4);fix-1— unanswered—
prompt
Our shipping quote function below has one bug. Bug report: this order is quoted 1525 cents, but the correct quote is 2074: {"country":"BR","items":[{"grams":370,"qty":3,"price":1449,"fragile":false}]} Fix the bug without changing any other behaviour, then run the fixed quote() on each of the 20 orders below, in order. Respond with just the 20 results separated by commas. const ZONES = { FR: 1, DE: 1, ES: 1, IT: 1, GB: 2, US: 2, CA: 2, JP: 3, BR: 3, AU: 3 }; // any other country is zone 4 const BASE = [0, 449, 754, 1159, 1858]; // cents, by zone const PER_STEP = [0, 83, 113, 183, 244]; // cents per 250 g step, by zone const FREE_BASE_OVER = [0, 5400, 11900, 18700, Infinity]; // order value (cents) that waives the base fee function quote(order) { const zone = ZONES[order.country] ?? 4; let grams = 0; let value = 0; let fragile = 0; for (const item of order.items) { grams += item.grams; value += item.price * item.qty; if (item.fragile) fragile += item.qty; } const steps = Math.max(1, Math.ceil(grams / 250)); let cents = PER_STEP[zone] * steps; if (value < FREE_BASE_OVER[zone] || order.express) cents += BASE[zone]; cents += Math.min(fragile, 3) * (120 + 35 * zone); if (order.express) cents = Math.ceil((cents * (zone <= 2 ? 150 : 185)) / 100); if (order.coupon === "SHIP10") cents -= Math.min(cents >> 3, 500); return Math.max(cents, 99); } Orders: {"country":"CA","items":[{"grams":869,"qty":1,"price":1337,"fragile":false},{"grams":783,"qty":1,"price":1939,"fragile":false},{"grams":538,"qty":2,"price":1791,"fragile":false},{"grams":179,"qty":5,"price":4951,"fragile":true}]} {"country":"AU","items":[{"grams":1791,"qty":1,"price":2758,"fragile":false}],"coupon":"SHIP10"} {"country":"IT","items":[{"grams":865,"qty":4,"price":2641,"fragile":false}]} {"country":"BR","items":[{"grams":1548,"qty":1,"price":1000,"fragile":false},{"grams":448,"qty":2,"price":4676,"fragile":false},{"grams":1375,"qty":1,"price":603,"fragile":false}]} {"country":"US","items":[{"grams":506,"qty":2,"price":1431,"fragile":false}]} {"country":"IT","items":[{"grams":1139,"qty":1,"price":4344,"fragile":false}],"express":true} {"country":"JP","items":[{"grams":839,"qty":4,"price":1764,"fragile":false}]} {"country":"US","items":[{"grams":1672,"qty":5,"price":5537,"fragile":true},{"grams":419,"qty":3,"price":2992,"fragile":false}]} {"country":"CA","items":[{"grams":1726,"qty":3,"price":1759,"fragile":false},{"grams":379,"qty":4,"price":3579,"fragile":true},{"grams":277,"qty":4,"price":319,"fragile":true}],"express":true} {"country":"ES","items":[{"grams":303,"qty":3,"price":433,"fragile":false}]} {"country":"MX","items":[{"grams":934,"qty":1,"price":8936,"fragile":true}],"express":true} {"country":"MX","items":[{"grams":1724,"qty":1,"price":8734,"fragile":false},{"grams":1321,"qty":2,"price":1937,"fragile":false},{"grams":1513,"qty":1,"price":5548,"fragile":false}]} {"country":"JP","items":[{"grams":914,"qty":1,"price":3149,"fragile":true},{"grams":1440,"qty":1,"price":4785,"fragile":true},{"grams":1245,"qty":1,"price":2503,"fragile":false},{"grams":1014,"qty":4,"price":6266,"fragile":true}],"coupon":"SHIP10"} {"country":"BR","items":[{"grams":555,"qty":1,"price":8132,"fragile":false},{"grams":1576,"qty":4,"price":8449,"fragile":true}],"coupon":"SHIP10"} {"country":"MX","items":[{"grams":383,"qty":3,"price":5967,"fragile":false},{"grams":1665,"qty":3,"price":7249,"fragile":false},{"grams":312,"qty":3,"price":3466,"fragile":false},{"grams":503,"qty":1,"price":1847,"fragile":false}],"express":true} {"country":"ES","items":[{"grams":1642,"qty":4,"price":1263,"fragile":false},{"grams":262,"qty":2,"price":768,"fragile":false},{"grams":156,"qty":2,"price":2132,"fragile":false},{"grams":826,"qty":1,"price":7651,"fragile":false}]} {"country":"JP","items":[{"grams":571,"qty":4,"price":935,"fragile":false}]} {"country":"US","items":[{"grams":139,"qty":1,"price":6622,"fragile":false},{"grams":1080,"qty":1,"price":8077,"fragile":false},{"grams":1523,"qty":4,"price":582,"fragile":false},{"grams":672,"qty":1,"price":2809,"fragile":false}]} {"country":"GB","items":[{"grams":842,"qty":3,"price":1057,"fragile":false}]} {"country":"AU","items":[{"grams":727,"qty":5,"price":2264,"fragile":false}]}implement-1— unanswered—
prompt
Write a function mergeIntervals(intervals). Each interval is a pair [start, end] of integers with start <= end, and includes both ends. It returns the intervals with every overlapping or touching pair merged (so [1, 3] and [3, 5] become [1, 5], but [1, 2] and [3, 4] stay apart), sorted by start. The input may be in any order. Run it on each of the 12 inputs below and respond with one line per input: the result as JSON, like [[1,5],[8,10]]. Spaces are ignored. [] [[1,3],[3,5]] [[1,2],[3,4]] [[5,9],[1,10]] [[40,43],[39,41],[14,16],[27,28],[27,27]] [[8,12],[16,16],[16,19],[4,9],[21,21],[35,38],[26,28],[34,35]] [[31,32],[0,6],[36,39],[21,25]] [[5,5],[34,41],[35,35],[29,37],[35,36],[5,11]] [[14,21],[5,10],[4,11],[14,20],[6,6],[17,25],[14,18]] [[16,19],[23,28],[2,6],[40,48],[1,1],[8,11],[36,36],[29,35]] [[24,31],[6,9],[11,14],[11,17],[7,14],[17,24]] [[30,31],[33,34],[20,22],[27,28],[32,32],[9,16],[35,38],[38,39]]repo-1— unanswered—
prompt
Download agentcheckup.ai/f/dc6fae8a56ed8da7940098d820452960.zip and unzip it. It contains a small Python project (Python 3.10 or newer, standard library only) with a bug. Find and fix it, then run `python main.py data/real.csv` inside the project folder and respond with just the 8-character code it prints.repo-2— unanswered—
prompt
Download agentcheckup.ai/f/c5cdf79289ae037ee5c2268e299dd97a.zip and unzip it. It contains a small Python project (Python 3.10 or newer, standard library only) with bugs. Find and fix them, then run `python main.py data/real.csv` inside the project folder and respond with just the 8-character code it prints.
discussion
Sign in to join the discussion
No messages yet.