Models

BH Galaxy

Device keys in tt-inference-server: BLACKHOLE_GALAXY.

Community models are tt-model bundles published by their owners and are not in tt-inference-server's release spec. Tenstorrent has not reviewed them. Serve at your own risk.

6 models
LLMOfficial

gemma-4-12B-it

google/gemma-4-12B-it

Listed in tt-inference-server on 2 hardware types; best status Complete. 1 tt-model bundle also published.

Runs on
BH Galaxy, BH QuietBox 2, p100 +1
Status
Complete
tt launch
7 clients
12B parameters1 tt-model bundle
LLMOfficial

gemma-4-31B-it

google/gemma-4-31B-it

Listed in tt-inference-server on 2 hardware types; best status Complete.

Runs on
BH Galaxy, BH QuietBox 2
Status
Complete
tt launch
7 clients
31B parameters
LLMOfficial

Qwen3-32B

Qwen/Qwen3-32B

Listed in tt-inference-server on 5 hardware types; best status Complete. 3 tt-model bundles also published.

Runs on
BH 4xP150, BH Galaxy, BH LoudBox +4
Speed
≥ 78 tok/s≤ 60 ms WH Galaxy
Status
Complete
tt launch
7 clients
32B parameters3 tt-model bundles
Video generationOfficial

Wan2.2-T2V-A14B-Diffusers

Wan-AI/Wan2.2-T2V-A14B-Diffusers

Listed in tt-inference-server on 6 hardware types; best status Complete.

Runs on
BH 4xP150, BH Galaxy, BH LoudBox +3
Status
Complete
tt launch
None
14B parameters
LLMOfficial

gpt-oss-120b

openai/gpt-oss-120b

Listed in tt-inference-server on 4 hardware types; best status Experimental. 3 tt-model bundles also published.

Runs on
BH 4xP150, BH Galaxy, BH LoudBox +3
Speed
≥ 2.7 tok/s≤ 510 ms BH QuietBox 2
Status
Experimental
tt launch
7 clients
120B parameters3 tt-model bundles
LLM (inferred)Community model

Motif-3

Motif-Technologies/Motif-3

Published as 1 tt-model bundle by changh95.

Runs on
BH Galaxy
Status
Not in the release spec
tt launch
None
1 tt-model bundle