BH LoudBox
Device keys in tt-inference-server: P150X8.
Community models are tt-model bundles published by their owners and are not in tt-inference-server's release spec. Tenstorrent has not reviewed them. Serve at your own risk.
DeepSeek-R1-Distill-Llama-70B
Listed in tt-inference-server on 5 hardware types; best status Complete.
- Runs on
- BH 4xP150, BH LoudBox, BH QuietBox 2 +2
- Status
- Complete
- tt launch
- 7 clients
FLUX.1-dev
Listed in tt-inference-server on 6 hardware types; best status Complete.
- Runs on
- BH 4xP150, BH LoudBox, BH P300 +3
- Status
- Complete
- tt launch
- None
FLUX.1-schnell
Listed in tt-inference-server on 6 hardware types; best status Complete.
- Runs on
- BH 4xP150, BH LoudBox, BH P300 +3
- Status
- Complete
- tt launch
- None
Llama-3.1-70B
Listed in tt-inference-server on 5 hardware types; best status Complete.
- Runs on
- BH 4xP150, BH LoudBox, BH QuietBox 2 +2
- Speed
- ≥ 10 tok/s≤ 238 ms WH Galaxy
- Status
- Complete
- tt launch
- 7 clients
Llama-3.1-70B-Instruct
Listed in tt-inference-server on 5 hardware types; best status Complete.
- Runs on
- BH 4xP150, BH LoudBox, BH QuietBox 2 +2
- Speed
- ≥ 9.5 tok/s≤ 226 ms WH Galaxy
- Status
- Complete
- tt launch
- 7 clients
Llama-3.1-8B
Listed in tt-inference-server on 8 hardware types; best status Complete.
- Runs on
- BH LoudBox, BH P300, BH QuietBox 2 +5
- Speed
- ≥ 85 tok/s≤ 46 ms WH LoudBox/QuietBox
- Status
- Complete
- tt launch
- 7 clients
Llama-3.1-8B-Instruct
Listed in tt-inference-server on 9 hardware types; best status Complete.
- Runs on
- BH LoudBox, BH P300, BH QuietBox 2 +6
- Speed
- ≥ 36 tok/s≤ 58 ms WH LoudBox/QuietBox
- Status
- Complete
- tt launch
- 7 clients
Llama-3.3-70B-Instruct
Listed in tt-inference-server on 5 hardware types; best status Complete.
- Runs on
- BH 4xP150, BH LoudBox, BH QuietBox 2 +2
- Speed
- ≥ 14 tok/s≤ 76 ms WH Galaxy
- Status
- Complete
- tt launch
- 7 clients
mochi-1-preview
Listed in tt-inference-server on 3 hardware types; best status Complete.
- Runs on
- BH LoudBox, WH Galaxy, WH LoudBox/QuietBox
- Status
- Complete
- tt launch
- None
Qwen3-32B
Listed in tt-inference-server on 5 hardware types; best status Complete. 3 tt-model bundles also published.
- Runs on
- BH 4xP150, BH Galaxy, BH LoudBox +4
- Speed
- ≥ 78 tok/s≤ 60 ms WH Galaxy
- Status
- Complete
- tt launch
- 7 clients
Wan2.2-T2V-A14B-Diffusers
Listed in tt-inference-server on 6 hardware types; best status Complete.
- Runs on
- BH 4xP150, BH Galaxy, BH LoudBox +3
- Status
- Complete
- tt launch
- None
gpt-oss-120b
Listed in tt-inference-server on 4 hardware types; best status Experimental. 3 tt-model bundles also published.
- Runs on
- BH 4xP150, BH Galaxy, BH LoudBox +3
- Speed
- ≥ 2.7 tok/s≤ 510 ms BH QuietBox 2
- Status
- Experimental
- tt launch
- 7 clients
EXAONE-4.5-33B
Published as 1 tt-model bundle by changh95.
- Runs on
- BH LoudBox
- Status
- Not in the release spec
- tt launch
- 7 clients
gpt-oss-20b
gpt-oss-20b, OpenAI's 21B-parameter mixture-of-experts reasoning model (3.6B active parameters), served with vLLM for chat, reasoning and function calling.
- Runs on
- BH 4xP150, BH LoudBox, p150 +1
- Speed
- 48 tok/s209 ms 1 chip
- Status
- Not in the release spec
- tt launch
- 7 clients
Qwen3.8-Flash-Next
Qwen3.8-Flash-Next, a mixture-of-experts model with 125B parameters (about 6B active per token) plus a 51B n-gram embedding table, served with vLLM as a text-only chat and completion endpoint with tool calling and separated reasoning…
- Runs on
- BH 4xP150, BH LoudBox, BH QuietBox 2
- Speed
- 24 tok/s340 ms 4 chips
- Status
- Not in the release spec
- tt launch
- 7 clients
Solar-Open-100B
Published as 1 tt-model bundle by changh95.
- Runs on
- BH LoudBox
- Status
- Not in the release spec
- tt launch
- 7 clients
No model in this list matches the filter.