Models

Functional

Models whose best status in the release spec is Functional.

12 models
LLMOfficial

Llama-3.2-1B

meta-llama/Llama-3.2-1B

Listed in tt-inference-server on 3 hardware types; best status Functional.

Runs on
WH LoudBox/QuietBox, n150, n300
Speed
≥ 18 tok/s≤ 60 ms WH LoudBox/QuietBox
Status
Functional
tt launch
7 clients
1B parameters
LLMOfficial

Llama-3.2-1B-Instruct

meta-llama/Llama-3.2-1B-Instruct

Listed in tt-inference-server on 3 hardware types; best status Functional.

Runs on
WH LoudBox/QuietBox, n150, n300
Speed
≥ 36 tok/s≤ 70 ms WH LoudBox/QuietBox
Status
Functional
tt launch
7 clients
1B parameters
LLMOfficial

Llama-3.2-3B

meta-llama/Llama-3.2-3B

Listed in tt-inference-server on 3 hardware types; best status Functional.

Runs on
WH LoudBox/QuietBox, n150, n300
Speed
≥ 6.1 tok/s≤ 170 ms WH LoudBox/QuietBox
Status
Functional
tt launch
7 clients
3B parameters
LLMOfficial

Llama-3.2-3B-Instruct

meta-llama/Llama-3.2-3B-Instruct

Listed in tt-inference-server on 3 hardware types; best status Functional. 1 tt-model bundle also published.

Runs on
WH LoudBox/QuietBox, n150, n300 +2
Speed
≥ 17 tok/s≤ 120 ms WH LoudBox/QuietBox
Status
Functional
tt launch
7 clients
3B parameters1 tt-model bundle
LLMOfficial

Qwen2.5-72B

Qwen/Qwen2.5-72B

Listed in tt-inference-server on 2 hardware types; best status Functional.

Runs on
WH Galaxy, WH LoudBox/QuietBox
Speed
≥ 8.2 tok/s≤ 130 ms WH Galaxy
Status
Functional
tt launch
7 clients
72B parameters
LLMOfficial

Qwen2.5-72B-Instruct

Qwen/Qwen2.5-72B-Instruct

Listed in tt-inference-server on 2 hardware types; best status Functional.

Runs on
WH Galaxy, WH LoudBox/QuietBox
Speed
≥ 7.1 tok/s≤ 510 ms WH Galaxy
Status
Functional
tt launch
7 clients
72B parameters
LLMOfficial

Qwen3-8B

Qwen/Qwen3-8B

Listed in tt-inference-server on 4 hardware types; best status Functional.

Runs on
WH Galaxy, WH LoudBox/QuietBox, n150 +1
Speed
≥ 60 tok/s≤ 120 ms WH Galaxy
Status
Functional
tt launch
7 clients
8B parameters
VLMOfficial

Qwen3-VL-32B-Instruct

Qwen/Qwen3-VL-32B-Instruct

Listed in tt-inference-server on 1 hardware type; best status Functional.

Runs on
WH LoudBox/QuietBox
Speed
≥ 3.8 tok/s≤ 1.5 s WH LoudBox/QuietBox
Status
Functional
tt launch
2 clients
32B parameters
LLMOfficial

QwQ-32B

Qwen/QwQ-32B

Listed in tt-inference-server on 2 hardware types; best status Functional.

Runs on
WH Galaxy, WH LoudBox/QuietBox
Speed
≥ 16 tok/s≤ 300 ms WH Galaxy
Status
Functional
tt launch
7 clients
32B parameters
CNNOfficial

resnet-50

resnet-50

Listed in tt-inference-server on 2 hardware types; best status Functional.

Runs on
n150, n300
Status
Functional
tt launch
None
CNNOfficial

segformer

segformer

Listed in tt-inference-server on 2 hardware types; best status Functional.

Runs on
n150, n300
Status
Functional
tt launch
None
Image generationOfficial

Z-Image-Turbo

Tongyi-MAI/Z-Image-Turbo

Listed in tt-inference-server on 1 hardware type; best status Functional. 1 tt-model bundle also published.

Runs on
BH QuietBox 2, p100a
Status
Functional
tt launch
None
1 tt-model bundle