Models

Qwen

Models whose name starts with Qwen.

Community models are tt-model bundles published by their owners and are not in tt-inference-server's release spec. Tenstorrent has not reviewed them. Serve at your own risk.

20 models
LLMOfficial

Qwen3-32B

Qwen/Qwen3-32B

Listed in tt-inference-server on 5 hardware types; best status Complete. 3 tt-model bundles also published.

Runs on
BH 4xP150, BH Galaxy, BH LoudBox +4
Speed
≥ 78 tok/s≤ 60 ms WH Galaxy
Status
Complete
tt launch
7 clients
32B parameters3 tt-model bundles
LLMOfficial

Qwen3.8-27B

Qwen/Qwen3.8-27B

Listed in tt-inference-server on 1 hardware type; best status Complete. 3 tt-model bundles also published.

Runs on
BH 4xP150, BH QuietBox 2, p150x2
Speed
≥ 20 tok/s≤ 124 ms BH QuietBox 2
Status
Complete
tt launch
7 clients
27B parameters3 tt-model bundles
LLMOfficial

Qwen2.5-72B

Qwen/Qwen2.5-72B

Listed in tt-inference-server on 2 hardware types; best status Functional.

Runs on
WH Galaxy, WH LoudBox/QuietBox
Speed
≥ 8.2 tok/s≤ 130 ms WH Galaxy
Status
Functional
tt launch
7 clients
72B parameters
LLMOfficial

Qwen2.5-72B-Instruct

Qwen/Qwen2.5-72B-Instruct

Listed in tt-inference-server on 2 hardware types; best status Functional.

Runs on
WH Galaxy, WH LoudBox/QuietBox
Speed
≥ 7.1 tok/s≤ 510 ms WH Galaxy
Status
Functional
tt launch
7 clients
72B parameters
LLMOfficial

Qwen3-8B

Qwen/Qwen3-8B

Listed in tt-inference-server on 4 hardware types; best status Functional.

Runs on
WH Galaxy, WH LoudBox/QuietBox, n150 +1
Speed
≥ 60 tok/s≤ 120 ms WH Galaxy
Status
Functional
tt launch
7 clients
8B parameters
VLMOfficial

Qwen3-VL-32B-Instruct

Qwen/Qwen3-VL-32B-Instruct

Listed in tt-inference-server on 1 hardware type; best status Functional.

Runs on
WH LoudBox/QuietBox
Speed
≥ 3.8 tok/s≤ 1.5 s WH LoudBox/QuietBox
Status
Functional
tt launch
2 clients
32B parameters
EmbeddingOfficial

Qwen3-Embedding-0.6B

Qwen/Qwen3-Embedding-0.6B

Listed in tt-inference-server on 1 hardware type; best status Experimental.

Runs on
BH QuietBox 2
Status
Experimental
tt launch
None
EmbeddingOfficial

Qwen3-Embedding-4B

Qwen/Qwen3-Embedding-4B

Listed in tt-inference-server on 1 hardware type; best status Experimental.

Runs on
BH QuietBox 2
Status
Experimental
tt launch
None
4B parameters
EmbeddingOfficial

Qwen3-Embedding-8B

Qwen/Qwen3-Embedding-8B

Listed in tt-inference-server on 4 hardware types; best status Experimental.

Runs on
WH Galaxy, WH LoudBox/QuietBox, n150 +1
Status
Experimental
tt launch
None
8B parameters
LLMOfficial

Qwen3.6-27B

Qwen/Qwen3.6-27B

Listed in tt-inference-server on 1 hardware type; best status Experimental. 1 tt-model bundle also published.

Runs on
BH 4xP150, BH QuietBox 2
Status
Experimental
tt launch
7 clients
27B parameters1 tt-model bundle
Image generation (inferred)Community model

Qwen-Image-2.1

Qwen/Qwen-Image-2.1

Published as 1 tt-model bundle by changh95.

Runs on
p150
Status
Not in the release spec
tt launch
None
1 tt-model bundle
Image generation (inferred)Community model

Qwen-Image-Edit_ComfyUI

Comfy-Org/Qwen-Image-Edit_ComfyUI

Published as 1 tt-model bundle by sunandbean.

Runs on
p100a
Status
Not in the release spec
tt launch
None
1 tt-model bundle
LLM (inferred)Community model

Qwen3-Coder-30B-A3B-Instruct

Qwen/Qwen3-Coder-30B-A3B-Instruct

Qwen3-Coder-30B-A3B-Instruct (30B total / 3B active MoE: 128 experts, top-8, 48 layers) for agentic coding with tool calling on Blackhole through vLLM, with a fused MoE decode: the v1 bundle (raahemnabeel/qwen3-coder-30b-a3b-v1) plus the…

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +2
Speed
96 tok/s145 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
LLM (inferred)Community model

Qwen3-Coder-Next

Qwen/Qwen3-Coder-Next

Qwen3-Coder-Next (80B total / 3B active MoE: 512 experts, top-10 + shared expert, 48 layers of Gated DeltaNet + gated attention) on Blackhole through vLLM and the Tenstorrent plugin, with a fused decode step: the v1 bundle…

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +1
Speed
179 tok/s173 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
Text-to-speechCommunity model

Qwen3-TTS-12Hz-1.7B-Base

Qwen/Qwen3-TTS-12Hz-1.7B-Base

Qwen3-TTS 1.7B Base, a text-to-speech model that clones the voice of a 3 to 10 s reference clip, in ten languages.

Runs on
p150
Status
Not in the release spec
tt launch
None
1 tt-model bundle
Text-to-speechCommunity model

Qwen3-TTS-12Hz-1.7B-CustomVoice

Qwen/Qwen3-TTS-12Hz-1.7B-CustomVoice

Qwen3-TTS 1.7B CustomVoice, a text-to-speech model with nine built-in speakers and ten languages.

Runs on
p150
Status
Not in the release spec
tt launch
None
1 tt-model bundle
Text-to-speechCommunity model

Qwen3-TTS-12Hz-1.7B-VoiceDesign

Qwen/Qwen3-TTS-12Hz-1.7B-VoiceDesign

Qwen3-TTS 1.7B VoiceDesign, a text-to-speech model that speaks in a voice described in a sentence, in ten languages.

Runs on
p150
Status
Not in the release spec
tt launch
None
1 tt-model bundle
LLM (inferred)Community model

Qwen3.5-122B-A10B

Qwen/Qwen3.5-122B-A10B

Qwen3.5-122B-A10B, a 122B-parameter mixture-of-experts model with 10B parameters active per token (256 experts, top-8 plus a shared expert; 48 layers mixing Gated DeltaNet linear attention with gated full attention) and a vision encoder,…

Runs on
BH 4xP150, BH QuietBox 2
Speed
131 tok/s216 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
LLM (inferred)Community model

Qwen3.6-35B-A3B

Qwen/Qwen3.6-35B-A3B

Published as 2 tt-model bundles by Adartras, rothgar.

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +2
Status
Not in the release spec
tt launch
7 clients
2 tt-model bundles
LLMCommunity model

Qwen3.8-Flash-Next

Qwen/Qwen3.8-Flash-Next

Qwen3.8-Flash-Next, a mixture-of-experts model with 125B parameters (about 6B active per token) plus a 51B n-gram embedding table, served with vLLM as a text-only chat and completion endpoint with tool calling and separated reasoning…

Runs on
BH 4xP150, BH LoudBox, BH QuietBox 2
Speed
24 tok/s340 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
5 tt-model bundles