MODEL EVALUATION DASHBOARD

Gemini 3.7 Flash

Evaluating agent task completion, skill acceleration, latency, and token economics on 31 benchmark tasks.
Model: gemini/gemini-3.7-flash • Sampling: k=1 (62 runs total)

🌟 With Skills
100.0%
PASS RATE (31/31)
Pass rate achieved when the agent utilizes AtomisticSkills domain tools and workflows.
14m
MEAN LATENCY
Mean wall-clock execution time for the agent to complete the task with domain skills.
17.4k
MEAN OUT TOKENS
Mean output tokens generated by the LLM (total completion tokens, including reasoning/thinking tokens where applicable) when utilizing domain skills.
83.7%
CACHE HIT RATE
Percentage of input tokens served from provider KV cache during with-skills runs (Cached Tokens / Total Input Tokens).
⚖️ No Skills
80.6%
PASS RATE (25/31)
Baseline pass rate achieved when the agent attempts tasks using only general coding tools without domain skills.
15m
MEAN LATENCY
Mean wall-clock execution time for the agent without domain skills.
22.9k
MEAN OUT TOKENS
Mean output tokens generated without domain skills (total completion tokens, including reasoning/thinking tokens). Without structured skills, models frequently burn more tokens exploring.
82.2%
CACHE HIT RATE
Percentage of input tokens served from provider KV cache during baseline no-skills runs.
+19.4%
SKILL BOOST Δ
Absolute pass rate gain achieved over the no-skills baseline: (With-Skills Pass) - (No-Skills Pass).
$26.89
TOTAL COST (62 RUNS)
Total LLM inference cost computed from provider token pricing, incorporating cached input discounts.
Discipline Task Name With Skills No Skills All Solvers Time (With / No) Out Tokens (With / No) Action
chemistry bde-weak-bonds 1/1 1/1 2/2 (100.0%) 70m/41m 14.1k/22.5k View Details →
chemistry conformer-boltzmann-ranking 1/1 0/1 1/2 (50.0%) 42m/19m 33.2k/36.5k View Details →
chemistry gas-thermochemistry-equilibrium 1/1 1/1 2/2 (100.0%) 268s/121s 11.4k/12.5k View Details →
chemistry ghs-hazard-summary 1/1 0/1 1/2 (50.0%) 132s/243s 3.7k/24.8k View Details →
chemistry ir-spectrum-match 1/1 1/1 2/2 (100.0%) 129s/88s 8.6k/9.8k View Details →
chemistry mof-dac-screening 1/1 1/1 2/2 (100.0%) 10m/498s 24.6k/30.1k View Details →
chemistry nmr-reaction-kinetics 1/1 1/1 2/2 (100.0%) 226s/345s 9.1k/26.9k View Details →
drug-discovery admet-lead-triage 1/1 1/1 2/2 (100.0%) 142s/68s 17.3k/24.5k View Details →
drug-discovery docking-microstate-enrichment 1/1 1/1 2/2 (100.0%) 318s/248s 64.4k/46.9k View Details →
drug-discovery ecfp-analog-diversity 1/1 1/1 2/2 (100.0%) 50s/36s 4.9k/10.0k View Details →
drug-discovery ligand-box-definition 1/1 1/1 2/2 (100.0%) 187s/43s 20.3k/8.8k View Details →
drug-discovery ligand-md-stability 1/1 1/1 2/2 (100.0%) 177s/66s 22.0k/12.8k View Details →
drug-discovery pose-quality-filter 1/1 1/1 2/2 (100.0%) 64s/58s 4.3k/6.5k View Details →
drug-discovery symmetry-redocking-rmsd 1/1 1/1 2/2 (100.0%) 77s/69s 8.3k/7.7k View Details →
machine-learning committee-uncertainty-flagging 1/1 1/1 2/2 (100.0%) 229s/57s 9.2k/6.4k View Details →
machine-learning mlip-error-benchmark 1/1 1/1 2/2 (100.0%) 166s/147s 8.0k/14.5k View Details →
materials-science camgsi-elasticity-vrh 1/1 0/1 1/2 (50.0%) 215s/453s 19.2k/57.8k View Details →
materials-science co-adsorption-cu111 1/1 1/1 2/2 (100.0%) 25m/23m 24.2k/18.6k View Details →
materials-science convex-hull-stability 1/1 1/1 2/2 (100.0%) 16m/38m 18.1k/39.0k View Details →
materials-science crconi-order-disorder 1/1 1/1 2/2 (100.0%) 38m/43m 43.3k/49.6k View Details →
materials-science electrochemical-window 1/1 1/1 2/2 (100.0%) 17m/49m 35.5k/18.8k View Details →
materials-science li-qha-simulation 1/1 0/1 1/2 (50.0%) 15m/14m 25.1k/50.1k View Details →
materials-science lifepo4-intercalation-voltage 1/1 1/1 2/2 (100.0%) 14m/558s 8.9k/9.3k View Details →
materials-science mgo-vacancy-energy 1/1 1/1 2/2 (100.0%) 452s/26m 9.3k/18.5k View Details →
materials-science ni3al-surface-energy 1/1 1/1 2/2 (100.0%) 11m/17m 18.2k/20.5k View Details →
materials-science nist-janaf-query 1/1 1/1 2/2 (100.0%) 69s/88s 4.8k/13.6k View Details →
materials-science polymorph-free-energy 1/1 0/1 1/2 (50.0%) 92m/118m 17.0k/54.3k View Details →
materials-science si-eos-fit 1/1 1/1 2/2 (100.0%) 196s/178s 14.3k/11.4k View Details →
materials-science sic-thermal-conductivity 1/1 0/1 1/2 (50.0%) 581s/12m 8.7k/12.8k View Details →
materials-science synthesis-precursor-recommendation 1/1 1/1 2/2 (100.0%) 63s/72s 5.6k/4.1k View Details →
materials-science xrd-mixture-phase-fit 1/1 1/1 2/2 (100.0%) 21m/260s 24.5k/30.1k View Details →