← Back to Cross-Model Leaderboard
MODEL EVALUATION DASHBOARD

GPT-5.6 Luna

Evaluating agent task completion, skill acceleration, latency, and token economics on 31 benchmark tasks.
Model: openai/gpt-5.6-luna • Sampling: k=3 (186 runs total)

🌟 With Skills
95.7%
PASS RATE (89/93)
Pass rate achieved when the agent utilizes AtomisticSkills domain tools and workflows.
11m
MEAN LATENCY
Mean wall-clock execution time for the agent to complete the task with domain skills.
11.2k
MEAN OUT TOKENS
Mean output tokens generated by the LLM (total completion tokens, including reasoning/thinking tokens where applicable) when utilizing domain skills.
98.1%
CACHE HIT RATE
Percentage of input tokens served from provider KV cache during with-skills runs (Cached Tokens / Total Input Tokens).
⚖️ No Skills
73.1%
PASS RATE (68/93)
Baseline pass rate achieved when the agent attempts tasks using only general coding tools without domain skills.
11m
MEAN LATENCY
Mean wall-clock execution time for the agent without domain skills.
13.0k
MEAN OUT TOKENS
Mean output tokens generated without domain skills (total completion tokens, including reasoning/thinking tokens). Without structured skills, models frequently burn more tokens exploring.
98.0%
CACHE HIT RATE
Percentage of input tokens served from provider KV cache during baseline no-skills runs.
+22.6%
SKILL BOOST Δ
Absolute pass rate gain achieved over the no-skills baseline: (With-Skills Pass) - (No-Skills Pass).
$14.30
TOTAL COST (186 RUNS)
Total LLM inference cost computed from provider token pricing, incorporating cached input discounts.
Discipline Task Name With Skills No Skills All Solvers Time (With / No) Out Tokens (With / No) Action
chemistry bde-weak-bonds 3/3 2/3 5/6 (83.3%) 57m/20m 18.5k/18.1k View Details →
chemistry conformer-boltzmann-ranking 3/3 2/3 5/6 (83.3%) 37m/16m 22.3k/16.7k View Details →
chemistry gas-thermochemistry-equilibrium 3/3 3/3 6/6 (100.0%) 105s/145s 8.6k/8.8k View Details →
chemistry ghs-hazard-summary 3/3 0/3 3/6 (50.0%) 46s/88s 4.2k/10.2k View Details →
chemistry ir-spectrum-match 3/3 3/3 6/6 (100.0%) 64s/72s 6.4k/8.5k View Details →
chemistry mof-dac-screening 3/3 1/3 4/6 (66.7%) 16m/25m 15.0k/20.6k View Details →
chemistry nmr-reaction-kinetics 2/3 1/3 3/6 (50.0%) 134s/223s 6.9k/20.9k View Details →
drug-discovery admet-lead-triage 2/3 3/3 5/6 (83.3%) 64s/58s 6.8k/6.0k View Details →
drug-discovery docking-microstate-enrichment 3/3 3/3 6/6 (100.0%) 245s/229s 29.5k/25.7k View Details →
drug-discovery ecfp-analog-diversity 3/3 3/3 6/6 (100.0%) 28s/35s 2.6k/2.8k View Details →
drug-discovery ligand-box-definition 2/3 2/3 4/6 (66.7%) 40s/34s 4.0k/3.7k View Details →
drug-discovery ligand-md-stability 3/3 3/3 6/6 (100.0%) 81s/79s 8.1k/9.3k View Details →
drug-discovery pose-quality-filter 3/3 3/3 6/6 (100.0%) 75s/57s 7.5k/6.4k View Details →
drug-discovery symmetry-redocking-rmsd 3/3 3/3 6/6 (100.0%) 40s/41s 3.5k/3.6k View Details →
machine-learning committee-uncertainty-flagging 3/3 3/3 6/6 (100.0%) 85s/61s 5.4k/4.0k View Details →
machine-learning mlip-error-benchmark 3/3 3/3 6/6 (100.0%) 70s/98s 5.1k/6.4k View Details →
materials-science camgsi-elasticity-vrh 3/3 3/3 6/6 (100.0%) 282s/266s 10.0k/13.4k View Details →
materials-science co-adsorption-cu111 3/3 3/3 6/6 (100.0%) 25m/24m 19.9k/16.5k View Details →
materials-science convex-hull-stability 3/3 0/3 3/6 (50.0%) 389s/357s 13.7k/15.5k View Details →
materials-science crconi-order-disorder 3/3 1/3 4/6 (66.7%) 26m/100m 24.1k/40.2k View Details →
materials-science electrochemical-window 3/3 3/3 6/6 (100.0%) 10m/251s 16.4k/14.1k View Details →
materials-science li-qha-simulation 3/3 1/3 4/6 (66.7%) 297s/464s 10.9k/18.1k View Details →
materials-science lifepo4-intercalation-voltage 3/3 0/3 3/6 (50.0%) 501s/86s 8.4k/6.1k View Details →
materials-science mgo-vacancy-energy 3/3 0/3 3/6 (50.0%) 369s/426s 11.2k/12.7k View Details →
materials-science ni3al-surface-energy 3/3 1/3 4/6 (66.7%) 26m/24m 17.0k/19.5k View Details →
materials-science nist-janaf-query 3/3 3/3 6/6 (100.0%) 23s/20s 1.3k/861 View Details →
materials-science polymorph-free-energy 3/3 3/3 6/6 (100.0%) 90m/71m 16.8k/31.9k View Details →
materials-science si-eos-fit 3/3 3/3 6/6 (100.0%) 139s/135s 7.8k/6.8k View Details →
materials-science sic-thermal-conductivity 2/3 3/3 5/6 (83.3%) 381s/437s 9.1k/10.6k View Details →
materials-science synthesis-precursor-recommendation 3/3 3/3 6/6 (100.0%) 109s/72s 9.1k/6.1k View Details →
materials-science xrd-mixture-phase-fit 3/3 3/3 6/6 (100.0%) 440s/565s 15.8k/17.7k View Details →