Llama (3.1, 3.2, 3.3, 4) on ollama 7af39318

Run

Engine

ollama 7af39318 (7af393188defd52d370464de0d2064649cab9b41)

Run

2026-09-26T05:36:43Z to 2026-09-26T05:36:50Z

Platform

linux-x86_64, Python 3.12.3, canitoolcall 0.1.0.dev0

Strategies

one, special, token, rand:1:8, rand:2:8, rand:3:8, rand:4:8, rand:5:8 (normalization soft-v1); not counted for this engine: one, special, rand:1:8, rand:2:8, rand:3:8, rand:4:8, rand:5:8

Fixtures digest

a1e7b55367e195e8aa6e2ef746b2cc141b44f37caad0887ff8f30b104616f836 the fixture corpus used for this site matches the run

Engine details

{
  "go_version": "go1.26.0",
  "llama_cpp_build": "b11081",
  "llama_cpp_commit": "161755f",
  "pinned_version": "7af393188defd52d370464de0d2064649cab9b41",
  "runner": "llama-server token rendering (preserved_tokens) + model/parsers via server/routes.go flow",
  "tokens_per_step": "one"
}

Results file

data/ollama-7af39318.json

Checks

No checks applied (no supported fixtures).

Fixtures needing attention

Every supported fixture passed strictly on every realistic strategy.

Unsupported fixtures

The adapter declined these fixtures because this engine version has no parser for the family or model.

• llama/l3-bug-empty-json-object-in-content: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-bug-leading-json-object-in-content: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-bug-whole-call-single-delta: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-empty-arguments: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-json-answer-not-a-call: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-long-arguments: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-marker-in-arguments: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-meta-python-tag-type-function: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-multi-turn-second-call: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-nested-json: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-no-call: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-sglang-python-tag-call: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-sglang-text-before-python-tag: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-single-call: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-string-escapes: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-truncated-inside-parameters: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-typed-values: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-unicode-emoji: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-vllm-arguments-key: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-vllm-brackets-in-strings: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-vllm-deeply-nested: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-vllm-escaped-quotes: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-vllm-json-without-name-is-content: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l3-vllm-parameters-key: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l4-bug-leading-underscore-identifier: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l4-meta-pythonic-int-and-string: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l4-meta-pythonic-parallel: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l4-truncated-missing-close-bracket: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l4-vllm-pythonic-escaped-strings: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l4-vllm-pythonic-more-types: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l4-vllm-pythonic-no-call: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l4-vllm-pythonic-parallel-no-spaces: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l4-vllm-pythonic-parameterless: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered
• llama/l4-vllm-pythonic-python-start-end: no built-in Ollama parser for this model at the pin; Ollama serves it through a Go template with the legacy tools parser or through llama-server's native chat (see the llamacpp engine); legacy template parser not covered