Qwen
Models whose name starts with Qwen.
Community models are tt-model bundles published by their owners and are not in tt-inference-server's release spec. Tenstorrent has not reviewed them. Serve at your own risk.
Qwen2.5-VL-7B-Instruct
Listed in tt-inference-server on 2 hardware types; best status Complete.
- Runs on
- WH Galaxy, WH LoudBox/QuietBox
- Speed
- ≥ 22 tok/s≤ 100 ms WH Galaxy
- Status
- Complete
- tt launch
- 7 clients
Qwen3-32B
Listed in tt-inference-server on 5 hardware types; best status Complete. 3 tt-model bundles also published.
- Runs on
- BH 4xP150, BH Galaxy, BH LoudBox +4
- Speed
- ≥ 78 tok/s≤ 60 ms WH Galaxy
- Status
- Complete
- tt launch
- 7 clients
Qwen3.8-27B
Listed in tt-inference-server on 1 hardware type; best status Complete. 3 tt-model bundles also published.
- Runs on
- BH 4xP150, BH QuietBox 2, p150x2
- Speed
- ≥ 20 tok/s≤ 124 ms BH QuietBox 2
- Status
- Complete
- tt launch
- 7 clients
Qwen2.5-72B
Listed in tt-inference-server on 2 hardware types; best status Functional.
- Runs on
- WH Galaxy, WH LoudBox/QuietBox
- Speed
- ≥ 8.2 tok/s≤ 130 ms WH Galaxy
- Status
- Functional
- tt launch
- 7 clients
Qwen2.5-72B-Instruct
Listed in tt-inference-server on 2 hardware types; best status Functional.
- Runs on
- WH Galaxy, WH LoudBox/QuietBox
- Speed
- ≥ 7.1 tok/s≤ 510 ms WH Galaxy
- Status
- Functional
- tt launch
- 7 clients
Qwen2.5-VL-72B-Instruct
Listed in tt-inference-server on 1 hardware type; best status Functional.
- Runs on
- WH LoudBox/QuietBox
- Speed
- ≥ 2.0 tok/s≤ 3.1 s WH LoudBox/QuietBox
- Status
- Functional
- tt launch
- 7 clients
Qwen3-8B
Listed in tt-inference-server on 4 hardware types; best status Functional.
- Runs on
- WH Galaxy, WH LoudBox/QuietBox, n150 +1
- Speed
- ≥ 60 tok/s≤ 120 ms WH Galaxy
- Status
- Functional
- tt launch
- 7 clients
Qwen3-VL-32B-Instruct
Listed in tt-inference-server on 1 hardware type; best status Functional.
- Runs on
- WH LoudBox/QuietBox
- Speed
- ≥ 3.8 tok/s≤ 1.5 s WH LoudBox/QuietBox
- Status
- Functional
- tt launch
- 2 clients
Qwen2.5-VL-32B-Instruct
Listed in tt-inference-server on 1 hardware type; best status Experimental.
- Runs on
- WH LoudBox/QuietBox
- Speed
- ≥ 4.2 tok/s≤ 630 ms WH LoudBox/QuietBox
- Status
- Experimental
- tt launch
- 7 clients
Qwen3-Embedding-0.6B
Listed in tt-inference-server on 1 hardware type; best status Experimental.
- Runs on
- BH QuietBox 2
- Status
- Experimental
- tt launch
- None
Qwen3-Embedding-4B
Listed in tt-inference-server on 1 hardware type; best status Experimental.
- Runs on
- BH QuietBox 2
- Status
- Experimental
- tt launch
- None
Qwen3-Embedding-8B
Listed in tt-inference-server on 4 hardware types; best status Experimental.
- Runs on
- WH Galaxy, WH LoudBox/QuietBox, n150 +1
- Status
- Experimental
- tt launch
- None
Qwen3.5-27B
Listed in tt-inference-server on 1 hardware type; best status Experimental.
- Runs on
- BH 4xP150
- Status
- Experimental
- tt launch
- 7 clients
Qwen3.6-27B
Listed in tt-inference-server on 2 hardware types; best status Experimental. 1 tt-model bundle also published.
- Runs on
- BH 4xP150, BH QuietBox 2
- Status
- Experimental
- tt launch
- 7 clients
Qwen-Image-2.1
Published as 1 tt-model bundle by changh95.
- Runs on
- p150
- Status
- Not in the release spec
- tt launch
- None
Qwen-Image-Edit_ComfyUI
Published as 1 tt-model bundle by sunandbean.
- Runs on
- p100a
- Status
- Not in the release spec
- tt launch
- None
Qwen3-Coder-30B-A3B-Instruct
Qwen3-Coder-30B-A3B-Instruct (30B total / 3B active MoE: 128 experts, top-8, 48 layers) for agentic coding with tool calling on Blackhole through vLLM, with a fused MoE decode: the v1 bundle (raahemnabeel/qwen3-coder-30b-a3b-v1) plus the…
- Runs on
- BH 4xP150, BH P300, BH QuietBox 2 +2
- Speed
- 96 tok/s145 ms 4 chips
- Status
- Not in the release spec
- tt launch
- 7 clients
Qwen3-Coder-Next
Qwen3-Coder-Next (80B total / 3B active MoE: 512 experts, top-10 + shared expert, 48 layers of Gated DeltaNet + gated attention) on Blackhole through vLLM and the Tenstorrent plugin, with a fused decode step: the v1 bundle…
- Runs on
- BH 4xP150, BH P300, BH QuietBox 2 +1
- Speed
- 179 tok/s173 ms 4 chips
- Status
- Not in the release spec
- tt launch
- 7 clients
Qwen3-Reranker-4B
Qwen3-Reranker-4B, a text reranker for 100+ languages and code: it scores how well a document answers a query by reading logit("yes") - logit("no") at the end of the model card's prompt, served as a Cohere / Jina / vLLM-style /v1/rerank…
- Runs on
- BH 4xP150, BH P300, BH QuietBox 2 +2
- Status
- Not in the release spec
- tt launch
- None
Qwen3-TTS-12Hz-1.7B-Base
Qwen3-TTS 1.7B Base, a text-to-speech model that clones the voice of a 3 to 10 s reference clip, in ten languages.
- Runs on
- p150
- Status
- Not in the release spec
- tt launch
- None
Qwen3-TTS-12Hz-1.7B-CustomVoice
Qwen3-TTS 1.7B CustomVoice, a text-to-speech model with nine built-in speakers and ten languages.
- Runs on
- p150
- Status
- Not in the release spec
- tt launch
- None
Qwen3-TTS-12Hz-1.7B-VoiceDesign
Qwen3-TTS 1.7B VoiceDesign, a text-to-speech model that speaks in a voice described in a sentence, in ten languages.
- Runs on
- p150
- Status
- Not in the release spec
- tt launch
- None
Qwen3-VL-Embedding-8B
Qwen3-VL-Embedding-8B, a multimodal embedding model: text, images, screenshots, video, or a mix, map to one L2-normalised 4096-dimensional vector in a shared space (Matryoshka dimensions down to 64), served as an OpenAI-style…
- Runs on
- BH 4xP150, BH P300, BH QuietBox 2 +2
- Status
- Not in the release spec
- tt launch
- None
Qwen3-VL-Reranker-8B
Qwen3-VL-Reranker-8B, a multimodal reranker: it scores how well a document answers a query, where either side can be text, images, screenshots, video or a mix.
- Runs on
- BH 4xP150, BH P300, BH QuietBox 2 +2
- Status
- Not in the release spec
- tt launch
- None
Qwen3.5-122B-A10B
Qwen3.5-122B-A10B, a 122B-parameter mixture-of-experts model with 10B parameters active per token (256 experts, top-8 plus a shared expert; 48 layers mixing Gated DeltaNet linear attention with gated full attention) and a vision encoder,…
- Runs on
- BH 4xP150, BH QuietBox 2
- Speed
- 131 tok/s216 ms 4 chips
- Status
- Not in the release spec
- tt launch
- 7 clients
Qwen3.6-35B-A3B
Published as 2 tt-model bundles by Adartras, rothgar.
- Runs on
- BH 4xP150, BH P300, BH QuietBox 2 +2
- Status
- Not in the release spec
- tt launch
- 7 clients
Qwen3.8-Flash-Next
Qwen3.8-Flash-Next, a 125B-parameter mixture-of-experts model with about 6B parameters active per token (48 layers mixing gated delta-net and sparse attention, 512 routed experts, top-10 plus one shared expert, a 51B-parameter n-gram…
- Runs on
- BH 4xP150, BH LoudBox, BH QuietBox 2
- Speed
- 1.0 tok/s1 ms 4 chips
- Status
- Not in the release spec
- tt launch
- 7 clients
No model in this list matches the filter.