Models

BH P300

Device keys in tt-inference-server: P300.

Community models are tt-model bundles published by their owners and are not in tt-inference-server's release spec. Tenstorrent has not reviewed them. Serve at your own risk.

12 models
Image generationOfficial

FLUX.1-dev

black-forest-labs/FLUX.1-dev

Listed in tt-inference-server on 6 hardware types; best status Complete.

Runs on
BH 4xP150, BH LoudBox, BH P300 +3
Status
Complete
tt launch
None
Image generationOfficial

FLUX.1-schnell

black-forest-labs/FLUX.1-schnell

Listed in tt-inference-server on 6 hardware types; best status Complete.

Runs on
BH 4xP150, BH LoudBox, BH P300 +3
Status
Complete
tt launch
None
LLMOfficial

Llama-3.1-8B

meta-llama/Llama-3.1-8B

Listed in tt-inference-server on 8 hardware types; best status Complete.

Runs on
BH LoudBox, BH P300, BH QuietBox 2 +5
Speed
≥ 85 tok/s≤ 46 ms WH LoudBox/QuietBox
Status
Complete
tt launch
7 clients
8B parameters
LLMOfficial

Llama-3.1-8B-Instruct

meta-llama/Llama-3.1-8B-Instruct

Listed in tt-inference-server on 9 hardware types; best status Complete.

Runs on
BH LoudBox, BH P300, BH QuietBox 2 +6
Speed
≥ 36 tok/s≤ 58 ms WH LoudBox/QuietBox
Status
Complete
tt launch
7 clients
8B parameters
LLM (inferred)Community model

GLM-4.5-Air

zai-org/GLM-4.5-Air

Published as 1 tt-model bundle by raahemnabeel.

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +1
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
LLM (inferred)Community model

Kimi-Linear-48B-A3B-Instruct

moonshotai/Kimi-Linear-48B-A3B-Instruct

Published as 1 tt-model bundle by jashansinghTT.

Runs on
BH P300, BH QuietBox 2
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
LLMCommunity model

Olmo-3.1-32B-Instruct

allenai/Olmo-3.1-32B-Instruct

Olmo 3.1 32B Instruct, a fully open 32B dense decoder with hybrid sliding-window / full attention and 65k context, served with vLLM.

Runs on
BH P300, BH QuietBox 2, p150
Speed
11 tok/s177 ms 1 chip
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
LLM (inferred)Community model

Ornith-1.5-35B-A3B

ornith-ai/Ornith-1.5-35B-A3B

Ornith-1.5-35B-A3B (35B total / 3B active MoE: 256 experts, top-8 + shared expert, 40 layers of Gated DeltaNet + gated attention, vision tower, MTP head) on Blackhole through vLLM and the Tenstorrent plugin, with a fused decode step: the…

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +3
Speed
220 tok/s118 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
2 tt-model bundles
LLM (inferred)Community model

Qwen3-Coder-30B-A3B-Instruct

Qwen/Qwen3-Coder-30B-A3B-Instruct

Qwen3-Coder-30B-A3B-Instruct (30B total / 3B active MoE: 128 experts, top-8, 48 layers) for agentic coding with tool calling on Blackhole through vLLM, with a fused MoE decode: the v1 bundle (raahemnabeel/qwen3-coder-30b-a3b-v1) plus the…

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +2
Speed
96 tok/s145 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
LLM (inferred)Community model

Qwen3-Coder-Next

Qwen/Qwen3-Coder-Next

Qwen3-Coder-Next (80B total / 3B active MoE: 512 experts, top-10 + shared expert, 48 layers of Gated DeltaNet + gated attention) on Blackhole through vLLM and the Tenstorrent plugin, with a fused decode step: the v1 bundle…

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +1
Speed
179 tok/s173 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
LLM (inferred)Community model

Qwen3.6-35B-A3B

Qwen/Qwen3.6-35B-A3B

Published as 2 tt-model bundles by Adartras, rothgar.

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +2
Status
Not in the release spec
tt launch
7 clients
2 tt-model bundles
Text-to-speechCommunity model

s2-pro

fishaudio/s2-pro

Fish Audio S2 Pro, a 4.5B dual-autoregressive text-to-speech model (Qwen3-based semantic decoder, 400M codebook decoder, 44.1 kHz DAC codec) on Tenstorrent Blackhole, with a fish-speech-compatible /v1/tts API (streaming WAV, voice cloning…

Runs on
BH P300, BH QuietBox 2, p100 +1
Status
Not in the release spec
tt launch
None
2 tt-model bundles