Tool call support (Llama 3.x, Functionary v3, Hermes 2 Pro, Mistral Nemo, generic) w/ lazy grammars & minimalist Jinja engine #15565
| Job | Run time |
|---|---|
| 3m 52s | |
| 8m 59s | |
| 8m 46s | |
| 2m 17s | |
| 1m 38s | |
| 1m 52s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 8m 41s | |
| 1s | |
| 8m 4s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 9m 38s | |
| 1s | |
| 1s | |
| 2m 30s | |
| 1s | |
| 3m 34s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 1s | |
| 0s | |
| 1s | |
| 1s | |
| 1h 0m 21s |