Models

BH QuietBox 2

Device keys in tt-inference-server: P300X2.

Community models are tt-model bundles published by their owners and are not in tt-inference-server's release spec. Tenstorrent has not reviewed them. Serve at your own risk.

45 models
LLMOfficial

DeepSeek-R1-Distill-Llama-70B

deepseek-ai/DeepSeek-R1-Distill-Llama-70B

Listed in tt-inference-server on 5 hardware types; best status Complete.

Runs on
BH 4xP150, BH LoudBox, BH QuietBox 2 +2
Status
Complete
tt launch
7 clients
70B parameters
Speech-to-textOfficial

distil-large-v3

distil-whisper/distil-large-v3

Listed in tt-inference-server on 6 hardware types; best status Complete.

Runs on
BH QuietBox 2, WH Galaxy, WH LoudBox/QuietBox +3
Status
Complete
tt launch
None
Image generationOfficial

FLUX.1-dev

black-forest-labs/FLUX.1-dev

Listed in tt-inference-server on 6 hardware types; best status Complete.

Runs on
BH 4xP150, BH LoudBox, BH P300 +3
Status
Complete
tt launch
None
Image generationOfficial

FLUX.1-schnell

black-forest-labs/FLUX.1-schnell

Listed in tt-inference-server on 6 hardware types; best status Complete.

Runs on
BH 4xP150, BH LoudBox, BH P300 +3
Status
Complete
tt launch
None
LLMOfficial

gemma-4-12B-it

google/gemma-4-12B-it

Listed in tt-inference-server on 2 hardware types; best status Complete. 1 tt-model bundle also published.

Runs on
BH Galaxy, BH QuietBox 2, p100 +1
Status
Complete
tt launch
7 clients
12B parameters1 tt-model bundle
LLMOfficial

gemma-4-31B-it

google/gemma-4-31B-it

Listed in tt-inference-server on 2 hardware types; best status Complete.

Runs on
BH Galaxy, BH QuietBox 2
Status
Complete
tt launch
7 clients
31B parameters
LLMOfficial

Llama-3.1-70B

meta-llama/Llama-3.1-70B

Listed in tt-inference-server on 5 hardware types; best status Complete.

Runs on
BH 4xP150, BH LoudBox, BH QuietBox 2 +2
Speed
≥ 10 tok/s≤ 238 ms WH Galaxy
Status
Complete
tt launch
7 clients
70B parameters
LLMOfficial

Llama-3.1-70B-Instruct

meta-llama/Llama-3.1-70B-Instruct

Listed in tt-inference-server on 5 hardware types; best status Complete.

Runs on
BH 4xP150, BH LoudBox, BH QuietBox 2 +2
Speed
≥ 9.5 tok/s≤ 226 ms WH Galaxy
Status
Complete
tt launch
7 clients
70B parameters
LLMOfficial

Llama-3.1-8B

meta-llama/Llama-3.1-8B

Listed in tt-inference-server on 8 hardware types; best status Complete.

Runs on
BH LoudBox, BH P300, BH QuietBox 2 +5
Speed
≥ 85 tok/s≤ 46 ms WH LoudBox/QuietBox
Status
Complete
tt launch
7 clients
8B parameters
LLMOfficial

Llama-3.1-8B-Instruct

meta-llama/Llama-3.1-8B-Instruct

Listed in tt-inference-server on 9 hardware types; best status Complete.

Runs on
BH LoudBox, BH P300, BH QuietBox 2 +6
Speed
≥ 36 tok/s≤ 58 ms WH LoudBox/QuietBox
Status
Complete
tt launch
7 clients
8B parameters
LLMOfficial

Llama-3.3-70B-Instruct

meta-llama/Llama-3.3-70B-Instruct

Listed in tt-inference-server on 5 hardware types; best status Complete.

Runs on
BH 4xP150, BH LoudBox, BH QuietBox 2 +2
Speed
≥ 14 tok/s≤ 76 ms WH Galaxy
Status
Complete
tt launch
7 clients
70B parameters
LLMOfficial

Qwen3-32B

Qwen/Qwen3-32B

Listed in tt-inference-server on 5 hardware types; best status Complete. 3 tt-model bundles also published.

Runs on
BH 4xP150, BH Galaxy, BH LoudBox +4
Speed
≥ 78 tok/s≤ 60 ms WH Galaxy
Status
Complete
tt launch
7 clients
32B parameters3 tt-model bundles
LLMOfficial

Qwen3.8-27B

Qwen/Qwen3.8-27B

Listed in tt-inference-server on 1 hardware type; best status Complete. 3 tt-model bundles also published.

Runs on
BH 4xP150, BH QuietBox 2, p150x2
Speed
≥ 20 tok/s≤ 124 ms BH QuietBox 2
Status
Complete
tt launch
7 clients
27B parameters3 tt-model bundles
Video generationOfficial

Wan2.2-T2V-A14B-Diffusers

Wan-AI/Wan2.2-T2V-A14B-Diffusers

Listed in tt-inference-server on 6 hardware types; best status Complete.

Runs on
BH 4xP150, BH Galaxy, BH LoudBox +3
Status
Complete
tt launch
None
14B parameters
Speech-to-textOfficial

whisper-large-v3

openai/whisper-large-v3

Listed in tt-inference-server on 6 hardware types; best status Complete.

Runs on
BH QuietBox 2, WH Galaxy, WH LoudBox/QuietBox +3
Status
Complete
tt launch
None
Image generationOfficial

Z-Image-Turbo

Tongyi-MAI/Z-Image-Turbo

Listed in tt-inference-server on 1 hardware type; best status Functional. 1 tt-model bundle also published.

Runs on
BH QuietBox 2, p100a
Status
Functional
tt launch
None
1 tt-model bundle
EmbeddingOfficial

bge-m3

BAAI/bge-m3

Listed in tt-inference-server on 1 hardware type; best status Experimental.

Runs on
BH QuietBox 2
Status
Experimental
tt launch
None
LLMOfficial

diffusiongemma-26B-A4B-it

google/diffusiongemma-26B-A4B-it

Listed in tt-inference-server on 1 hardware type; best status Experimental.

Runs on
BH QuietBox 2
Status
Experimental
tt launch
2 clients
4B parameters
LLMOfficial

gpt-oss-120b

openai/gpt-oss-120b

Listed in tt-inference-server on 4 hardware types; best status Experimental. 3 tt-model bundles also published.

Runs on
BH 4xP150, BH Galaxy, BH LoudBox +3
Speed
≥ 2.7 tok/s≤ 510 ms BH QuietBox 2
Status
Experimental
tt launch
7 clients
120B parameters3 tt-model bundles
EmbeddingOfficial

Qwen3-Embedding-0.6B

Qwen/Qwen3-Embedding-0.6B

Listed in tt-inference-server on 1 hardware type; best status Experimental.

Runs on
BH QuietBox 2
Status
Experimental
tt launch
None
EmbeddingOfficial

Qwen3-Embedding-4B

Qwen/Qwen3-Embedding-4B

Listed in tt-inference-server on 1 hardware type; best status Experimental.

Runs on
BH QuietBox 2
Status
Experimental
tt launch
None
4B parameters
LLMOfficial

Qwen3.6-27B

Qwen/Qwen3.6-27B

Listed in tt-inference-server on 1 hardware type; best status Experimental. 1 tt-model bundle also published.

Runs on
BH 4xP150, BH QuietBox 2
Status
Experimental
tt launch
7 clients
27B parameters1 tt-model bundle
Text-to-speechOfficial

speecht5_tts

microsoft/speecht5_tts

Listed in tt-inference-server on 2 hardware types; best status Experimental.

Runs on
BH QuietBox 2, p150
Status
Experimental
tt launch
None
LLM (inferred)Community model

DeepSeek-V4.1-Flash

deepseek-ai/DeepSeek-V4.1-Flash

Published as 1 tt-model bundle by rothgar.

Runs on
BH QuietBox 2
Status
Not in the release spec
tt launch
None
1 tt-model bundle
LLMCommunity model

ELYZA-Thinking-1.0-llm-jp-4-33b

elyza/ELYZA-Thinking-1.0-llm-jp-4-33b

elyza/ELYZA-Thinking-1.0-llm-jp-4-33b (ELYZA-Thinking 1.0, a reasoning model post-trained by ELYZA on llm-jp/llm-jp-4-33b-base) served by vLLM and the Tenstorrent vLLM plugin on a QuietBox 2 (two p300c boards, four Blackhole chips, mesh…

Runs on
BH QuietBox 2
Speed
21 tok/s293 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
Image generation (inferred)Community model

FLUX.2-dev

black-forest-labs/FLUX.2-dev

Published as 1 tt-model bundle by stisiTT.

Runs on
BH QuietBox 2
Status
Not in the release spec
tt launch
None
1 tt-model bundle
LLM (inferred)Community model

GLM-4.5-Air

zai-org/GLM-4.5-Air

Published as 1 tt-model bundle by raahemnabeel.

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +1
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
LLM (inferred)Community model

GLM-5.3-Flash

zai-org/GLM-5.3-Flash

Published as 1 tt-model bundle by raahemnabeel.

Runs on
BH 4xP150, BH QuietBox 2
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
LLM (inferred)Community model

Kimi-Linear-48B-A3B-Instruct

moonshotai/Kimi-Linear-48B-A3B-Instruct

Published as 1 tt-model bundle by jashansinghTT.

Runs on
BH P300, BH QuietBox 2
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
LLMCommunity model

llm-jp-4-33b-thinking

llm-jp/llm-jp-4-33b-thinking

llm-jp/llm-jp-4-33b-thinking (LLM-jp-4 33B, thinking) served by vLLM and the Tenstorrent vLLM plugin on a QuietBox 2 (two p300c boards, four Blackhole chips, mesh P300x2).

Runs on
BH QuietBox 2
Speed
20 tok/s342 ms 4 chips
Status
Not in the release spec
tt launch
2 clients
1 tt-model bundle
Image text to videoCommunity model

MiniMax-H3

MiniMaxAI/MiniMax-H3

MiniMax-H3 on Tenstorrent Blackhole: a 50-block diffusion transformer that generates video and the matching stereo soundtrack in one pass, conditioned by a Qwen3-VL-32B text/vision encoder.

Runs on
BH QuietBox 2, p150
Status
Not in the release spec
tt launch
None
1 tt-model bundle
LLM (inferred)Community model

Mistral-Small-4-119B-2603

mistralai/Mistral-Small-4-119B-2603

Published as 1 tt-model bundle by ndaly.

Runs on
BH QuietBox 2
Status
Not in the release spec
tt launch
2 clients
1 tt-model bundle
LLMCommunity model

Muse-Glimmer-30B

meta-models/Muse-Glimmer-30B

Muse-Glimmer-30B, a dense transformer of about 29.6B parameters including its vision encoder, served with vLLM as a text-only endpoint for long-context agentic coding with tool calling and separated reasoning output.

Runs on
BH QuietBox 2
Speed
42 tok/s70 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
LLM (inferred)Community model

NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4

nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4

NVIDIA Nemotron 3.5 Lightning 30B-A3B (NVFP4 checkpoint), a hybrid Mamba-Transformer mixture-of-experts reasoning model with a 1,048,576-token context, ported to Tenstorrent Blackhole and served through stock vLLM 0.26.0 plus the…

Runs on
BH QuietBox 2
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
LLMCommunity model

Olmo-3.1-32B-Instruct

allenai/Olmo-3.1-32B-Instruct

Olmo 3.1 32B Instruct, a fully open 32B dense decoder with hybrid sliding-window / full attention and 65k context, served with vLLM.

Runs on
BH P300, BH QuietBox 2, p150
Speed
11 tok/s177 ms 1 chip
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
LLM (inferred)Community model

Ornith-1.5-122B

ornith-ai/Ornith-1.5-122B

Ornith-1.5-122B, a 122B-parameter mixture-of-experts model with 10B parameters active per token (256 experts, top-8 plus a shared expert; 48 layers mixing Gated DeltaNet linear attention with gated full attention; the Qwen3.5-122B-A10B…

Runs on
BH 4xP150, BH QuietBox 2
Speed
133 tok/s230 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
LLM (inferred)Community model

Ornith-1.5-35B-A3B

ornith-ai/Ornith-1.5-35B-A3B

Ornith-1.5-35B-A3B (35B total / 3B active MoE: 256 experts, top-8 + shared expert, 40 layers of Gated DeltaNet + gated attention, vision tower, MTP head) on Blackhole through vLLM and the Tenstorrent plugin, with a fused decode step: the…

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +3
Speed
220 tok/s118 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
2 tt-model bundles
Robotics (inferred)Community model

pi05_base

lerobot/pi05_base

Published as 2 tt-model bundles by changh95.

Runs on
BH QuietBox 2, p150
Status
Not in the release spec
tt launch
None
2 tt-model bundles
LLM (inferred)Community model

Qwen3-Coder-30B-A3B-Instruct

Qwen/Qwen3-Coder-30B-A3B-Instruct

Qwen3-Coder-30B-A3B-Instruct (30B total / 3B active MoE: 128 experts, top-8, 48 layers) for agentic coding with tool calling on Blackhole through vLLM, with a fused MoE decode: the v1 bundle (raahemnabeel/qwen3-coder-30b-a3b-v1) plus the…

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +2
Speed
96 tok/s145 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
LLM (inferred)Community model

Qwen3-Coder-Next

Qwen/Qwen3-Coder-Next

Qwen3-Coder-Next (80B total / 3B active MoE: 512 experts, top-10 + shared expert, 48 layers of Gated DeltaNet + gated attention) on Blackhole through vLLM and the Tenstorrent plugin, with a fused decode step: the v1 bundle…

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +1
Speed
179 tok/s173 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
LLM (inferred)Community model

Qwen3.5-122B-A10B

Qwen/Qwen3.5-122B-A10B

Qwen3.5-122B-A10B, a 122B-parameter mixture-of-experts model with 10B parameters active per token (256 experts, top-8 plus a shared expert; 48 layers mixing Gated DeltaNet linear attention with gated full attention) and a vision encoder,…

Runs on
BH 4xP150, BH QuietBox 2
Speed
131 tok/s216 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
LLM (inferred)Community model

Qwen3.6-35B-A3B

Qwen/Qwen3.6-35B-A3B

Published as 2 tt-model bundles by Adartras, rothgar.

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +2
Status
Not in the release spec
tt launch
7 clients
2 tt-model bundles
LLMCommunity model

Qwen3.8-Flash-Next

Qwen/Qwen3.8-Flash-Next

Qwen3.8-Flash-Next, a mixture-of-experts model with 125B parameters (about 6B active per token) plus a 51B n-gram embedding table, served with vLLM as a text-only chat and completion endpoint with tool calling and separated reasoning…

Runs on
BH 4xP150, BH LoudBox, BH QuietBox 2
Speed
24 tok/s340 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
5 tt-model bundles
Text-to-speechCommunity model

s2-pro

fishaudio/s2-pro

Fish Audio S2 Pro, a 4.5B dual-autoregressive text-to-speech model (Qwen3-based semantic decoder, 400M codebook decoder, 44.1 kHz DAC codec) on Tenstorrent Blackhole, with a fish-speech-compatible /v1/tts API (streaming WAV, voice cloning…

Runs on
BH P300, BH QuietBox 2, p100 +1
Status
Not in the release spec
tt launch
None
2 tt-model bundles
Speech-to-textCommunity model

Voxtral-Mini-4B-Realtime-2602

mistralai/Voxtral-Mini-4B-Realtime-2602

Voxtral-Mini-4B-Realtime-2602, Mistral AI's realtime speech-to-text model (a 970M-parameter causal audio encoder feeding a 3.4B Ministral text decoder; 13 languages; one text token per 80 ms of audio), served on four Blackhole chips (2 x…

Runs on
BH QuietBox 2
Status
Not in the release spec
tt launch
2 clients
1 tt-model bundle