Models

Qwen

Models whose name starts with Qwen.

Community models are tt-model bundles published by their owners and are not in tt-inference-server's release spec. Tenstorrent has not reviewed them. Serve at your own risk.

27 models
VLMOfficial

Qwen2.5-VL-7B-Instruct

Qwen/Qwen2.5-VL-7B-Instruct

Listed in tt-inference-server on 2 hardware types; best status Complete.

Runs on
WH Galaxy, WH LoudBox/QuietBox
Speed
≥ 22 tok/s≤ 100 ms WH Galaxy
Status
Complete
tt launch
7 clients
7B parameters
LLMOfficial

Qwen3-32B

Qwen/Qwen3-32B

Listed in tt-inference-server on 5 hardware types; best status Complete. 3 tt-model bundles also published.

Runs on
BH 4xP150, BH Galaxy, BH LoudBox +4
Speed
≥ 78 tok/s≤ 60 ms WH Galaxy
Status
Complete
tt launch
7 clients
32B parameters3 tt-model bundles
LLMOfficial

Qwen3.8-27B

Qwen/Qwen3.8-27B

Listed in tt-inference-server on 1 hardware type; best status Complete. 3 tt-model bundles also published.

Runs on
BH 4xP150, BH QuietBox 2, p150x2
Speed
≥ 20 tok/s≤ 124 ms BH QuietBox 2
Status
Complete
tt launch
7 clients
27B parameters3 tt-model bundles
LLMOfficial

Qwen2.5-72B

Qwen/Qwen2.5-72B

Listed in tt-inference-server on 2 hardware types; best status Functional.

Runs on
WH Galaxy, WH LoudBox/QuietBox
Speed
≥ 8.2 tok/s≤ 130 ms WH Galaxy
Status
Functional
tt launch
7 clients
72B parameters
LLMOfficial

Qwen2.5-72B-Instruct

Qwen/Qwen2.5-72B-Instruct

Listed in tt-inference-server on 2 hardware types; best status Functional.

Runs on
WH Galaxy, WH LoudBox/QuietBox
Speed
≥ 7.1 tok/s≤ 510 ms WH Galaxy
Status
Functional
tt launch
7 clients
72B parameters
VLMOfficial

Qwen2.5-VL-72B-Instruct

Qwen/Qwen2.5-VL-72B-Instruct

Listed in tt-inference-server on 1 hardware type; best status Functional.

Runs on
WH LoudBox/QuietBox
Speed
≥ 2.0 tok/s≤ 3.1 s WH LoudBox/QuietBox
Status
Functional
tt launch
7 clients
72B parameters
LLMOfficial

Qwen3-8B

Qwen/Qwen3-8B

Listed in tt-inference-server on 4 hardware types; best status Functional.

Runs on
WH Galaxy, WH LoudBox/QuietBox, n150 +1
Speed
≥ 60 tok/s≤ 120 ms WH Galaxy
Status
Functional
tt launch
7 clients
8B parameters
VLMOfficial

Qwen3-VL-32B-Instruct

Qwen/Qwen3-VL-32B-Instruct

Listed in tt-inference-server on 1 hardware type; best status Functional.

Runs on
WH LoudBox/QuietBox
Speed
≥ 3.8 tok/s≤ 1.5 s WH LoudBox/QuietBox
Status
Functional
tt launch
2 clients
32B parameters
VLMOfficial

Qwen2.5-VL-32B-Instruct

Qwen/Qwen2.5-VL-32B-Instruct

Listed in tt-inference-server on 1 hardware type; best status Experimental.

Runs on
WH LoudBox/QuietBox
Speed
≥ 4.2 tok/s≤ 630 ms WH LoudBox/QuietBox
Status
Experimental
tt launch
7 clients
32B parameters
EmbeddingOfficial

Qwen3-Embedding-0.6B

Qwen/Qwen3-Embedding-0.6B

Listed in tt-inference-server on 1 hardware type; best status Experimental.

Runs on
BH QuietBox 2
Status
Experimental
tt launch
None
EmbeddingOfficial

Qwen3-Embedding-4B

Qwen/Qwen3-Embedding-4B

Listed in tt-inference-server on 1 hardware type; best status Experimental.

Runs on
BH QuietBox 2
Status
Experimental
tt launch
None
4B parameters
EmbeddingOfficial

Qwen3-Embedding-8B

Qwen/Qwen3-Embedding-8B

Listed in tt-inference-server on 4 hardware types; best status Experimental.

Runs on
WH Galaxy, WH LoudBox/QuietBox, n150 +1
Status
Experimental
tt launch
None
8B parameters
LLMOfficial

Qwen3.5-27B

Qwen/Qwen3.5-27B

Listed in tt-inference-server on 1 hardware type; best status Experimental.

Runs on
BH 4xP150
Status
Experimental
tt launch
7 clients
27B parameters
LLMOfficial

Qwen3.6-27B

Qwen/Qwen3.6-27B

Listed in tt-inference-server on 2 hardware types; best status Experimental. 1 tt-model bundle also published.

Runs on
BH 4xP150, BH QuietBox 2
Status
Experimental
tt launch
7 clients
27B parameters1 tt-model bundle
Image generation (inferred)Community model

Qwen-Image-2.1

Qwen/Qwen-Image-2.1

Published as 1 tt-model bundle by changh95.

Runs on
p150
Status
Not in the release spec
tt launch
None
1 tt-model bundle
Image generation (inferred)Community model

Qwen-Image-Edit_ComfyUI

Comfy-Org/Qwen-Image-Edit_ComfyUI

Published as 1 tt-model bundle by sunandbean.

Runs on
p100a
Status
Not in the release spec
tt launch
None
1 tt-model bundle
LLM (inferred)Community model

Qwen3-Coder-30B-A3B-Instruct

Qwen/Qwen3-Coder-30B-A3B-Instruct

Qwen3-Coder-30B-A3B-Instruct (30B total / 3B active MoE: 128 experts, top-8, 48 layers) for agentic coding with tool calling on Blackhole through vLLM, with a fused MoE decode: the v1 bundle (raahemnabeel/qwen3-coder-30b-a3b-v1) plus the…

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +2
Speed
96 tok/s145 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
LLM (inferred)Community model

Qwen3-Coder-Next

Qwen/Qwen3-Coder-Next

Qwen3-Coder-Next (80B total / 3B active MoE: 512 experts, top-10 + shared expert, 48 layers of Gated DeltaNet + gated attention) on Blackhole through vLLM and the Tenstorrent plugin, with a fused decode step: the v1 bundle…

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +1
Speed
179 tok/s173 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
Text rankingCommunity model

Qwen3-Reranker-4B

Qwen/Qwen3-Reranker-4B

Qwen3-Reranker-4B, a text reranker for 100+ languages and code: it scores how well a document answers a query by reading logit("yes") - logit("no") at the end of the model card's prompt, served as a Cohere / Jina / vLLM-style /v1/rerank…

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +2
Status
Not in the release spec
tt launch
None
1 tt-model bundle
Text-to-speechCommunity model

Qwen3-TTS-12Hz-1.7B-Base

Qwen/Qwen3-TTS-12Hz-1.7B-Base

Qwen3-TTS 1.7B Base, a text-to-speech model that clones the voice of a 3 to 10 s reference clip, in ten languages.

Runs on
p150
Status
Not in the release spec
tt launch
None
1 tt-model bundle
Text-to-speechCommunity model

Qwen3-TTS-12Hz-1.7B-CustomVoice

Qwen/Qwen3-TTS-12Hz-1.7B-CustomVoice

Qwen3-TTS 1.7B CustomVoice, a text-to-speech model with nine built-in speakers and ten languages.

Runs on
p150
Status
Not in the release spec
tt launch
None
1 tt-model bundle
Text-to-speechCommunity model

Qwen3-TTS-12Hz-1.7B-VoiceDesign

Qwen/Qwen3-TTS-12Hz-1.7B-VoiceDesign

Qwen3-TTS 1.7B VoiceDesign, a text-to-speech model that speaks in a voice described in a sentence, in ten languages.

Runs on
p150
Status
Not in the release spec
tt launch
None
1 tt-model bundle
EmbeddingCommunity model

Qwen3-VL-Embedding-8B

Qwen/Qwen3-VL-Embedding-8B

Qwen3-VL-Embedding-8B, a multimodal embedding model: text, images, screenshots, video, or a mix, map to one L2-normalised 4096-dimensional vector in a shared space (Matryoshka dimensions down to 64), served as an OpenAI-style…

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +2
Status
Not in the release spec
tt launch
None
1 tt-model bundle
Text rankingCommunity model

Qwen3-VL-Reranker-8B

Qwen/Qwen3-VL-Reranker-8B

Qwen3-VL-Reranker-8B, a multimodal reranker: it scores how well a document answers a query, where either side can be text, images, screenshots, video or a mix.

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +2
Status
Not in the release spec
tt launch
None
1 tt-model bundle
LLM (inferred)Community model

Qwen3.5-122B-A10B

Qwen/Qwen3.5-122B-A10B

Qwen3.5-122B-A10B, a 122B-parameter mixture-of-experts model with 10B parameters active per token (256 experts, top-8 plus a shared expert; 48 layers mixing Gated DeltaNet linear attention with gated full attention) and a vision encoder,…

Runs on
BH 4xP150, BH QuietBox 2
Speed
131 tok/s216 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
LLM (inferred)Community model

Qwen3.6-35B-A3B

Qwen/Qwen3.6-35B-A3B

Published as 2 tt-model bundles by Adartras, rothgar.

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +2
Status
Not in the release spec
tt launch
7 clients
2 tt-model bundles
VLMCommunity model

Qwen3.8-Flash-Next

Qwen/Qwen3.8-Flash-Next

Qwen3.8-Flash-Next, a 125B-parameter mixture-of-experts model with about 6B parameters active per token (48 layers mixing gated delta-net and sparse attention, 512 routed experts, top-10 plus one shared expert, a 51B-parameter n-gram…

Runs on
BH 4xP150, BH LoudBox, BH QuietBox 2
Speed
1.0 tok/s1 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
5 tt-model bundles