History
Raw benchmark run history from the database. 200 total rows — showing last 200.
| Time | Provider | Model | Test | Status | Latency | Tokens |
|---|---|---|---|---|---|---|
| 5/28/2026, 5:02:14 PM | groq | qwen/qwen3-32b | tool_use | pass | 579ms | 182 / 134 |
| 5/28/2026, 5:02:13 PM | groq | qwen/qwen3-32b | context | pass | 578ms | 204 / 100 |
| 5/28/2026, 5:02:12 PM | groq | qwen/qwen3-32b | speed | pass | 1942ms | 38 / 500 |
| 5/28/2026, 5:02:10 PM | groq | qwen/qwen3-32b | code | pass | 850ms | 41 / 300 |
| 5/28/2026, 5:02:09 PM | groq | qwen/qwen3-32b | json | pass | 541ms | 60 / 150 |
| 5/28/2026, 5:02:09 PM | groq | qwen/qwen3-32b | reasoning | pass | 561ms | 33 / 100 |
| 5/28/2026, 5:02:08 PM | groq | qwen/qwen3-32b | ping | pass | 345ms | 15 / 16 |
| 5/28/2026, 5:02:07 PM | groq | meta-llama/llama-4-scout-17b-16e-instruct | tool_use | pass | 406ms | 734 / 31 |
| 5/28/2026, 5:02:07 PM | groq | meta-llama/llama-4-scout-17b-16e-instruct | context | pass | 395ms | 198 / 56 |
| 5/28/2026, 5:02:06 PM | groq | meta-llama/llama-4-scout-17b-16e-instruct | speed | pass | 1425ms | 40 / 500 |
| 5/28/2026, 5:02:05 PM | groq | meta-llama/llama-4-scout-17b-16e-instruct | code | pass | 673ms | 43 / 152 |
| 5/28/2026, 5:02:04 PM | groq | meta-llama/llama-4-scout-17b-16e-instruct | json | pass | 378ms | 60 / 31 |
| 5/28/2026, 5:02:03 PM | groq | meta-llama/llama-4-scout-17b-16e-instruct | reasoning | pass | 357ms | 33 / 37 |
| 5/28/2026, 5:02:03 PM | groq | meta-llama/llama-4-scout-17b-16e-instruct | ping | pass | 514ms | 17 / 2 |
| 5/28/2026, 5:02:02 PM | anthropic | claude-haiku-4-5-20251001 | tool_use | pass | 1116ms | 594 / 56 |
| 5/28/2026, 5:02:01 PM | anthropic | claude-haiku-4-5-20251001 | context | pass | 982ms | 222 / 39 |
| 5/28/2026, 5:01:59 PM | anthropic | claude-haiku-4-5-20251001 | speed | pass | 5787ms | 38 / 500 |
| 5/28/2026, 5:01:54 PM | anthropic | claude-haiku-4-5-20251001 | code | pass | 2061ms | 40 / 245 |
| 5/28/2026, 5:01:51 PM | anthropic | claude-haiku-4-5-20251001 | json | pass | 1131ms | 59 / 47 |
| 5/28/2026, 5:01:50 PM | anthropic | claude-haiku-4-5-20251001 | reasoning | pass | 1131ms | 32 / 48 |
| 5/28/2026, 5:01:49 PM | anthropic | claude-haiku-4-5-20251001 | ping | pass | 737ms | 14 / 4 |
| 5/28/2026, 5:01:48 PM | gemini | gemini-2.0-flash | tool_use | fail | 390ms | — |
| 5/28/2026, 5:01:47 PM | gemini | gemini-2.0-flash | context | fail | 318ms | — |
| 5/28/2026, 5:01:47 PM | gemini | gemini-2.0-flash | speed | fail | 375ms | — |
| 5/28/2026, 5:01:46 PM | gemini | gemini-2.0-flash | code | fail | 294ms | — |
| 5/28/2026, 5:01:46 PM | gemini | gemini-2.0-flash | json | fail | 386ms | — |
| 5/28/2026, 5:01:45 PM | gemini | gemini-2.0-flash | reasoning | fail | 317ms | — |
| 5/28/2026, 5:01:45 PM | gemini | gemini-2.0-flash | ping | fail | 382ms | — |
| 5/28/2026, 4:05:14 PM | anthropic | claude-opus-4-1-20250805 | tool_use | pass | 2517ms | 411 / 69 |
| 5/28/2026, 4:05:11 PM | anthropic | claude-opus-4-1-20250805 | context | pass | 3228ms | 222 / 81 |
| 5/28/2026, 4:05:08 PM | anthropic | claude-opus-4-1-20250805 | speed | pass | 15283ms | 38 / 500 |
| 5/28/2026, 4:04:52 PM | anthropic | claude-opus-4-1-20250805 | code | pass | 5348ms | 40 / 252 |
| 5/28/2026, 4:04:47 PM | anthropic | claude-opus-4-1-20250805 | json | pass | 2328ms | 59 / 24 |
| 5/28/2026, 4:04:44 PM | anthropic | claude-opus-4-1-20250805 | reasoning | pass | 3508ms | 32 / 49 |
| 5/28/2026, 4:04:40 PM | anthropic | claude-opus-4-1-20250805 | ping | pass | 1894ms | 14 / 4 |
| 5/28/2026, 4:04:38 PM | anthropic | claude-haiku-4-5-20251001 | tool_use | pass | 1087ms | 594 / 56 |
| 5/28/2026, 4:04:37 PM | anthropic | claude-haiku-4-5-20251001 | context | pass | 1431ms | 222 / 44 |
| 5/28/2026, 4:04:35 PM | anthropic | claude-haiku-4-5-20251001 | speed | pass | 5822ms | 38 / 500 |
| 5/28/2026, 4:04:29 PM | anthropic | claude-haiku-4-5-20251001 | code | pass | 2250ms | 40 / 210 |
| 5/28/2026, 4:04:27 PM | anthropic | claude-haiku-4-5-20251001 | json | pass | 1263ms | 59 / 37 |
| 5/28/2026, 4:04:25 PM | anthropic | claude-haiku-4-5-20251001 | reasoning | pass | 1592ms | 32 / 41 |
| 5/28/2026, 4:04:23 PM | anthropic | claude-haiku-4-5-20251001 | ping | pass | 771ms | 14 / 4 |
| 5/28/2026, 2:11:52 PM | gemini | nano-banana-pro-preview | tool_use | pass | 3302ms | 81 / 18 |
| 5/28/2026, 2:11:48 PM | gemini | nano-banana-pro-preview | context | pass | 3887ms | 209 / 18 |
| 5/28/2026, 2:11:44 PM | gemini | nano-banana-pro-preview | speed | fail | 20070ms | — |
| 5/28/2026, 2:11:24 PM | gemini | nano-banana-pro-preview | code | pass | 15000ms | 33 / 193 |
| 5/28/2026, 2:11:09 PM | gemini | nano-banana-pro-preview | json | pass | 7282ms | 52 / 41 |
| 5/28/2026, 2:11:01 PM | gemini | nano-banana-pro-preview | reasoning | pass | 6993ms | 25 / 52 |
| 5/28/2026, 2:10:54 PM | gemini | nano-banana-pro-preview | ping | pass | 3137ms | 7 / 1 |
| 5/28/2026, 2:10:51 PM | gemini | gemma-4-31b-it | tool_use | pass | 4685ms | 84 / 18 |
| 5/28/2026, 2:10:46 PM | gemini | gemma-4-31b-it | context | pass | 6544ms | 212 / 11 |
| 5/28/2026, 2:10:39 PM | gemini | gemma-4-31b-it | speed | fail | 20049ms | — |
| 5/28/2026, 2:10:19 PM | gemini | gemma-4-31b-it | code | pass | 13759ms | 36 / 133 |
| 5/28/2026, 2:10:05 PM | gemini | gemma-4-31b-it | json | pass | 6810ms | 55 / 29 |
| 5/28/2026, 2:09:58 PM | gemini | gemma-4-31b-it | reasoning | pass | 13533ms | 28 / 42 |
| 5/28/2026, 2:09:44 PM | gemini | gemma-4-31b-it | ping | pass | 2484ms | 10 / 1 |
| 5/28/2026, 2:09:42 PM | gemini | gemma-4-26b-a4b-it | tool_use | pass | 3808ms | 84 / 18 |
| 5/28/2026, 2:09:38 PM | gemini | gemma-4-26b-a4b-it | context | pass | 6697ms | 212 / 11 |
| 5/28/2026, 2:09:31 PM | gemini | gemma-4-26b-a4b-it | speed | fail | 20056ms | — |
| 5/28/2026, 2:09:11 PM | gemini | gemma-4-26b-a4b-it | code | pass | 16441ms | 36 / 131 |
| 5/28/2026, 2:08:54 PM | gemini | gemma-4-26b-a4b-it | json | pass | 7475ms | 55 / 28 |
| 5/28/2026, 2:08:46 PM | gemini | gemma-4-26b-a4b-it | reasoning | fail | 20050ms | — |
| 5/28/2026, 2:08:26 PM | gemini | gemma-4-26b-a4b-it | ping | pass | 2128ms | 10 / 1 |
| 5/28/2026, 2:08:24 PM | gemini | gemini-pro-latest | tool_use | pass | 6701ms | 81 / 18 |
| 5/28/2026, 2:08:17 PM | gemini | gemini-pro-latest | context | pass | 4579ms | 209 / 18 |
| 5/28/2026, 2:08:12 PM | gemini | gemini-pro-latest | speed | fail | 20053ms | — |
| 5/28/2026, 2:07:52 PM | gemini | gemini-pro-latest | code | pass | 7990ms | 33 / 139 |
| 5/28/2026, 2:07:44 PM | gemini | gemini-pro-latest | json | pass | 4733ms | 52 / 29 |
| 5/28/2026, 2:07:39 PM | gemini | gemini-pro-latest | reasoning | pass | 7290ms | 25 / 36 |
| 5/28/2026, 2:07:31 PM | gemini | gemini-pro-latest | ping | pass | 2082ms | 7 / 1 |
| 5/28/2026, 2:07:29 PM | gemini | gemini-flash-lite-latest | tool_use | pass | 673ms | 81 / 18 |
| 5/28/2026, 2:07:28 PM | gemini | gemini-flash-lite-latest | context | pass | 602ms | 209 / 11 |
| 5/28/2026, 2:07:27 PM | gemini | gemini-flash-lite-latest | speed | pass | 4355ms | 30 / 1020 |
| 5/28/2026, 2:07:23 PM | gemini | gemini-flash-lite-latest | code | pass | 938ms | 33 / 131 |
| 5/28/2026, 2:07:22 PM | gemini | gemini-flash-lite-latest | json | pass | 623ms | 52 / 39 |
| 5/28/2026, 2:07:21 PM | gemini | gemini-flash-lite-latest | reasoning | pass | 690ms | 25 / 44 |
| 5/28/2026, 2:07:20 PM | gemini | gemini-flash-lite-latest | ping | pass | 530ms | 7 / 1 |
| 5/28/2026, 2:07:19 PM | gemini | gemini-flash-latest | tool_use | pass | 2303ms | 81 / 18 |
| 5/28/2026, 2:07:17 PM | gemini | gemini-flash-latest | context | pass | 1812ms | 209 / 51 |
| 5/28/2026, 2:07:15 PM | gemini | gemini-flash-latest | speed | pass | 6998ms | 30 / 38 |
| 5/28/2026, 2:07:07 PM | gemini | gemini-flash-latest | code | pass | 4726ms | 33 / 130 |
| 5/28/2026, 2:07:03 PM | gemini | gemini-flash-latest | json | pass | 2113ms | 52 / 29 |
| 5/28/2026, 2:07:00 PM | gemini | gemini-flash-latest | reasoning | pass | 3464ms | 25 / 63 |
| 5/28/2026, 2:06:57 PM | gemini | gemini-flash-latest | ping | pass | 1096ms | 7 / 1 |
| 5/28/2026, 2:06:55 PM | gemini | gemini-3.5-flash | tool_use | pass | 1893ms | 81 / 18 |
| 5/28/2026, 2:06:53 PM | gemini | gemini-3.5-flash | context | pass | 2418ms | 209 / 69 |
| 5/28/2026, 2:06:51 PM | gemini | gemini-3.5-flash | speed | pass | 5680ms | 30 / 40 |
| 5/28/2026, 2:06:45 PM | gemini | gemini-3.5-flash | code | pass | 3473ms | 33 / 135 |
| 5/28/2026, 2:06:41 PM | gemini | gemini-3.5-flash | json | pass | 2767ms | 52 / 29 |
| 5/28/2026, 2:06:38 PM | gemini | gemini-3.5-flash | reasoning | pass | 3446ms | 25 / 38 |
| 5/28/2026, 2:06:34 PM | gemini | gemini-3.5-flash | ping | pass | 1552ms | 7 / 1 |
| 5/28/2026, 2:06:33 PM | gemini | gemini-3.1-pro-preview-customtools | tool_use | pass | 2490ms | 81 / 18 |
| 5/28/2026, 2:06:30 PM | gemini | gemini-3.1-pro-preview-customtools | context | pass | 3997ms | 209 / 26 |
| 5/28/2026, 2:06:26 PM | gemini | gemini-3.1-pro-preview-customtools | speed | fail | 20047ms | — |
| 5/28/2026, 2:06:06 PM | gemini | gemini-3.1-pro-preview-customtools | code | pass | 7444ms | 33 / 139 |
| 5/28/2026, 2:05:58 PM | gemini | gemini-3.1-pro-preview-customtools | json | pass | 5341ms | 52 / 48 |
| 5/28/2026, 2:05:52 PM | gemini | gemini-3.1-pro-preview-customtools | reasoning | pass | 7636ms | 25 / 52 |
| 5/28/2026, 2:05:45 PM | gemini | gemini-3.1-pro-preview-customtools | ping | pass | 2852ms | 7 / 1 |
| 5/28/2026, 2:05:41 PM | gemini | gemini-3.1-pro-preview | tool_use | pass | 2991ms | 81 / 18 |
| 5/28/2026, 2:05:38 PM | gemini | gemini-3.1-pro-preview | context | pass | 4526ms | 209 / 26 |
| 5/28/2026, 2:05:34 PM | gemini | gemini-3.1-pro-preview | speed | fail | 20047ms | — |
| 5/28/2026, 2:05:13 PM | gemini | gemini-3.1-pro-preview | code | pass | 6165ms | 33 / 137 |
| 5/28/2026, 2:05:07 PM | gemini | gemini-3.1-pro-preview | json | pass | 5742ms | 52 / 48 |
| 5/28/2026, 2:05:01 PM | gemini | gemini-3.1-pro-preview | reasoning | pass | 8505ms | 25 / 36 |
| 5/28/2026, 2:04:52 PM | gemini | gemini-3.1-pro-preview | ping | pass | 2069ms | 7 / 1 |
| 5/28/2026, 2:04:50 PM | gemini | gemini-3.1-flash-lite-preview | tool_use | pass | 716ms | 81 / 18 |
| 5/28/2026, 2:04:49 PM | gemini | gemini-3.1-flash-lite-preview | context | pass | 926ms | 209 / 11 |
| 5/28/2026, 2:04:48 PM | gemini | gemini-3.1-flash-lite-preview | speed | pass | 4716ms | 30 / 1020 |
| 5/28/2026, 2:04:43 PM | gemini | gemini-3.1-flash-lite-preview | code | pass | 1155ms | 33 / 138 |
| 5/28/2026, 2:04:42 PM | gemini | gemini-3.1-flash-lite-preview | json | pass | 1075ms | 52 / 37 |
| 5/28/2026, 2:04:41 PM | gemini | gemini-3.1-flash-lite-preview | reasoning | pass | 763ms | 25 / 49 |
| 5/28/2026, 2:04:40 PM | gemini | gemini-3.1-flash-lite-preview | ping | pass | 605ms | 7 / 1 |
| 5/28/2026, 2:04:39 PM | gemini | gemini-3.1-flash-lite | tool_use | pass | 587ms | 81 / 18 |
| 5/28/2026, 2:04:38 PM | gemini | gemini-3.1-flash-lite | context | pass | 618ms | 209 / 11 |
| 5/28/2026, 2:04:37 PM | gemini | gemini-3.1-flash-lite | speed | pass | 4381ms | 30 / 1020 |
| 5/28/2026, 2:04:33 PM | gemini | gemini-3.1-flash-lite | code | pass | 905ms | 33 / 135 |
| 5/28/2026, 2:04:32 PM | gemini | gemini-3.1-flash-lite | json | pass | 712ms | 52 / 30 |
| 5/28/2026, 2:04:31 PM | gemini | gemini-3.1-flash-lite | reasoning | pass | 726ms | 25 / 49 |
| 5/28/2026, 2:04:30 PM | gemini | gemini-3.1-flash-lite | ping | pass | 717ms | 7 / 2 |
| 5/28/2026, 2:04:29 PM | gemini | gemini-3.1-flash-image-preview | tool_use | pass | 1191ms | 81 / 18 |
| 5/28/2026, 2:04:27 PM | gemini | gemini-3.1-flash-image-preview | context | pass | 1520ms | 209 / 11 |
| 5/28/2026, 2:04:26 PM | gemini | gemini-3.1-flash-image-preview | speed | pass | 6858ms | 30 / 1020 |
| 5/28/2026, 2:04:19 PM | gemini | gemini-3.1-flash-image-preview | code | pass | 1584ms | 33 / 111 |
| 5/28/2026, 2:04:17 PM | gemini | gemini-3.1-flash-image-preview | json | pass | 1562ms | 52 / 53 |
| 5/28/2026, 2:04:15 PM | gemini | gemini-3.1-flash-image-preview | reasoning | pass | 1507ms | 25 / 56 |
| 5/28/2026, 2:04:13 PM | gemini | gemini-3.1-flash-image-preview | ping | pass | 1191ms | 7 / 1 |
| 5/28/2026, 2:04:12 PM | gemini | gemini-3-pro-image-preview | tool_use | pass | 3284ms | 81 / 25 |
| 5/28/2026, 2:04:09 PM | gemini | gemini-3-pro-image-preview | context | pass | 5991ms | 209 / 18 |
| 5/28/2026, 2:04:02 PM | gemini | gemini-3-pro-image-preview | speed | fail | 20051ms | — |
| 5/28/2026, 2:03:42 PM | gemini | gemini-3-pro-image-preview | code | pass | 13637ms | 33 / 260 |
| 5/28/2026, 2:03:28 PM | gemini | gemini-3-pro-image-preview | json | pass | 5688ms | 52 / 49 |
| 5/28/2026, 2:03:22 PM | gemini | gemini-3-pro-image-preview | reasoning | pass | 8402ms | 25 / 25 |
| 5/28/2026, 2:03:14 PM | gemini | gemini-3-pro-image-preview | ping | pass | 2908ms | 7 / 1 |
| 5/28/2026, 2:03:11 PM | gemini | gemini-3-flash-preview | tool_use | pass | 2283ms | 81 / 18 |
| 5/28/2026, 2:03:08 PM | gemini | gemini-3-flash-preview | context | pass | 2995ms | 209 / 11 |
| 5/28/2026, 2:03:05 PM | gemini | gemini-3-flash-preview | speed | pass | 10292ms | 30 / 166 |
| 5/28/2026, 2:02:54 PM | gemini | gemini-3-flash-preview | code | pass | 3131ms | 33 / 139 |
| 5/28/2026, 2:02:51 PM | gemini | gemini-3-flash-preview | json | pass | 2646ms | 52 / 29 |
| 5/28/2026, 2:02:48 PM | gemini | gemini-3-flash-preview | reasoning | pass | 3806ms | 25 / 50 |
| 5/28/2026, 2:02:44 PM | gemini | gemini-3-flash-preview | ping | pass | 1505ms | 7 / 1 |
| 5/28/2026, 2:02:43 PM | gemini | gemini-2.5-pro | tool_use | pass | 3564ms | 79 / 17 |
| 5/28/2026, 2:02:39 PM | gemini | gemini-2.5-pro | context | pass | 6728ms | 209 / 44 |
| 5/28/2026, 2:02:32 PM | gemini | gemini-2.5-pro | speed | fail | 20064ms | — |
| 5/28/2026, 2:02:12 PM | gemini | gemini-2.5-pro | code | pass | 17734ms | 33 / 359 |
| 5/28/2026, 2:01:54 PM | gemini | gemini-2.5-pro | json | pass | 5620ms | 52 / 53 |
| 5/28/2026, 2:01:48 PM | gemini | gemini-2.5-pro | reasoning | pass | 7614ms | 25 / 32 |
| 5/28/2026, 2:01:40 PM | gemini | gemini-2.5-pro | ping | pass | 1940ms | 7 / 1 |
| 5/28/2026, 2:01:38 PM | gemini | gemini-2.5-flash-lite | tool_use | pass | 703ms | 79 / 17 |
| 5/28/2026, 2:01:37 PM | gemini | gemini-2.5-flash-lite | context | pass | 1100ms | 209 / 26 |
| 5/28/2026, 2:01:36 PM | gemini | gemini-2.5-flash-lite | speed | pass | 5245ms | 30 / 1022 |
| 5/28/2026, 2:01:30 PM | gemini | gemini-2.5-flash-lite | code | pass | 3961ms | 33 / 138 |
| 5/28/2026, 2:01:26 PM | gemini | gemini-2.5-flash-lite | json | pass | 3107ms | 52 / 31 |
| 5/28/2026, 2:01:23 PM | gemini | gemini-2.5-flash-lite | reasoning | pass | 979ms | 25 / 45 |
| 5/28/2026, 2:01:22 PM | gemini | gemini-2.5-flash-lite | ping | pass | 662ms | 7 / 1 |
| 5/28/2026, 2:01:21 PM | gemini | gemini-2.5-flash-image | context | pass | 831ms | 209 / 11 |
| 5/28/2026, 2:01:19 PM | gemini | gemini-2.5-flash-image | speed | pass | 6391ms | 30 / 1024 |
| 5/28/2026, 2:01:13 PM | gemini | gemini-2.5-flash-image | code | pass | 1528ms | 33 / 136 |
| 5/28/2026, 2:01:11 PM | gemini | gemini-2.5-flash-image | json | pass | 1099ms | 52 / 28 |
| 5/28/2026, 2:01:10 PM | gemini | gemini-2.5-flash-image | reasoning | pass | 856ms | 25 / 67 |
| 5/28/2026, 2:01:08 PM | gemini | gemini-2.5-flash-image | ping | pass | 651ms | 7 / 1 |
| 5/28/2026, 2:01:08 PM | gemini | gemini-2.5-flash | tool_use | pass | 1591ms | 79 / 17 |
| 5/28/2026, 2:01:06 PM | gemini | gemini-2.5-flash | context | pass | 4091ms | 209 / 52 |
| 5/28/2026, 2:01:02 PM | gemini | gemini-2.5-flash | speed | pass | 6476ms | 30 / 38 |
| 5/28/2026, 2:00:55 PM | gemini | gemini-2.5-flash | code | pass | 7038ms | 33 / 39 |
| 5/28/2026, 2:00:48 PM | gemini | gemini-2.5-flash | json | pass | 3303ms | 52 / 29 |
| 5/28/2026, 2:00:44 PM | gemini | gemini-2.5-flash | reasoning | pass | 2858ms | 25 / 61 |
| 5/28/2026, 2:00:41 PM | gemini | gemini-2.5-flash | ping | pass | 975ms | 7 / 1 |
| 5/28/2026, 1:17:04 PM | nvidia | meta/llama-3.3-70b-instruct | context | fail | 292ms | — |
| 5/28/2026, 1:17:03 PM | nvidia | meta/llama-3.3-70b-instruct | speed | fail | 318ms | — |
| 5/28/2026, 1:17:03 PM | nvidia | meta/llama-3.3-70b-instruct | code | pass | 7604ms | 68 / 190 |
| 5/28/2026, 1:16:55 PM | nvidia | meta/llama-3.3-70b-instruct | json | pass | 1552ms | 85 / 30 |
| 5/28/2026, 1:16:53 PM | nvidia | meta/llama-3.3-70b-instruct | reasoning | pass | 2753ms | 58 / 39 |
| 5/28/2026, 1:16:50 PM | nvidia | meta/llama-3.3-70b-instruct | ping | pass | 4681ms | 42 / 2 |
| 5/28/2026, 1:16:45 PM | openrouter | anthropic/claude-haiku-4.5 | context | pass | 1287ms | 222 / 44 |
| 5/28/2026, 1:16:44 PM | openrouter | anthropic/claude-haiku-4.5 | speed | pass | 4015ms | 38 / 500 |
| 5/28/2026, 1:16:36 PM | openrouter | anthropic/claude-haiku-4.5 | code | pass | 1538ms | 40 / 180 |
| 5/28/2026, 1:16:33 PM | openrouter | anthropic/claude-haiku-4.5 | json | pass | 3702ms | 59 / 37 |
| 5/28/2026, 1:16:29 PM | openrouter | anthropic/claude-haiku-4.5 | reasoning | pass | 4091ms | 32 / 41 |
| 5/28/2026, 1:16:24 PM | openrouter | anthropic/claude-haiku-4.5 | ping | pass | 2040ms | 14 / 4 |
| 5/28/2026, 1:16:22 PM | gemini | gemini-2.5-pro | tool_use | pass | 3923ms | 79 / 17 |
| 5/28/2026, 1:16:18 PM | gemini | gemini-2.5-pro | context | pass | 4112ms | 209 / 45 |
| 5/28/2026, 1:16:14 PM | gemini | gemini-2.5-pro | speed | fail | 20057ms | — |
| 5/28/2026, 1:15:53 PM | gemini | gemini-2.5-pro | code | pass | 15263ms | 33 / 321 |
| 5/28/2026, 1:15:38 PM | gemini | gemini-2.5-pro | json | pass | 6057ms | 52 / 45 |
| 5/28/2026, 1:15:31 PM | gemini | gemini-2.5-pro | reasoning | pass | 8911ms | 25 / 34 |
| 5/28/2026, 1:15:22 PM | gemini | gemini-2.5-pro | ping | pass | 2472ms | 7 / 1 |
| 5/28/2026, 1:15:20 PM | groq | llama-3.3-70b-versatile | tool_use | pass | 487ms | 242 / 23 |
| 5/28/2026, 1:15:19 PM | groq | llama-3.3-70b-versatile | context | pass | 362ms | 219 / 43 |
| 5/28/2026, 1:15:18 PM | groq | llama-3.3-70b-versatile | speed | pass | 1456ms | 65 / 500 |
| 5/28/2026, 1:15:17 PM | groq | llama-3.3-70b-versatile | code | pass | 842ms | 68 / 185 |
| 5/28/2026, 1:15:16 PM | groq | llama-3.3-70b-versatile | json | pass | 301ms | 85 / 30 |
| 5/28/2026, 1:15:15 PM | groq | llama-3.3-70b-versatile | reasoning | pass | 431ms | 58 / 33 |
| 5/28/2026, 1:15:14 PM | groq | llama-3.3-70b-versatile | ping | pass | 360ms | 42 / 2 |
| 5/28/2026, 1:15:14 PM | openai | gpt-4o-mini | tool_use | pass | 807ms | 71 / 16 |
| 5/28/2026, 1:15:13 PM | openai | gpt-4o-mini | context | pass | 1349ms | 190 / 32 |
| 5/28/2026, 1:15:11 PM | openai | gpt-4o-mini | speed | pass | 14836ms | 37 / 500 |
| 5/28/2026, 1:14:56 PM | openai | gpt-4o-mini | code | pass | 3117ms | 40 / 119 |
| 5/28/2026, 1:14:53 PM | openai | gpt-4o-mini | json | pass | 1190ms | 57 / 35 |
| 5/28/2026, 1:14:52 PM | openai | gpt-4o-mini | reasoning | pass | 8547ms | 30 / 31 |
| 5/28/2026, 1:14:43 PM | openai | gpt-4o-mini | ping | pass | 755ms | 14 / 1 |