Models

Newest tt-model bundles

The 20 models with the most recently pushed tt-model bundles, newest first.

Community models are tt-model bundles published by their owners and are not in tt-inference-server's release spec. Tenstorrent has not reviewed them. Serve at your own risk.

20 models
LLMOfficial

Qwen3.8-27B

Qwen/Qwen3.8-27B

Listed in tt-inference-server on 1 hardware type; best status Complete. 3 tt-model bundles also published.

Runs on
BH 4xP150, BH QuietBox 2, p150x2
Speed
≥ 20 tok/s≤ 124 ms BH QuietBox 2
Status
Complete
tt launch
7 clients
27B parameters3 tt-model bundles
LLMCommunity model

ELYZA-Thinking-1.0-llm-jp-4-33b

elyza/ELYZA-Thinking-1.0-llm-jp-4-33b

elyza/ELYZA-Thinking-1.0-llm-jp-4-33b (ELYZA-Thinking 1.0, a reasoning model post-trained by ELYZA on llm-jp/llm-jp-4-33b-base) served by vLLM and the Tenstorrent vLLM plugin on a QuietBox 2 (two p300c boards, four Blackhole chips, mesh…

Runs on
BH QuietBox 2
Speed
21 tok/s293 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
2 tt-model bundles
LLMOfficial

gpt-oss-120b

openai/gpt-oss-120b

Listed in tt-inference-server on 4 hardware types; best status Experimental. 3 tt-model bundles also published.

Runs on
BH 4xP150, BH Galaxy, BH LoudBox +3
Speed
≥ 2.7 tok/s≤ 510 ms BH QuietBox 2
Status
Experimental
tt launch
7 clients
120B parameters3 tt-model bundles
Served with vLLM, task not statedCommunity model

MIRA-SFT-35B-A3B

MIRA-MMDeepResearch/MIRA-SFT-35B-A3B

MIRA-SFT-35B-A3B, a multimodal deep-research agent model: Qwen3.6-35B-A3B (35B-parameter mixture of experts, 3B active per token: 256 experts, top-8 plus a shared expert; 40 layers mixing Gated DeltaNet linear attention with gated full…

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +3
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
Served with vLLM, task not statedCommunity model

Tongyi-DeepResearch-30B-A3B

Alibaba-NLP/Tongyi-DeepResearch-30B-A3B

Tongyi DeepResearch, an agent model for long-horizon, deep information seeking: a 30B-parameter mixture of experts with 3B active per token (Qwen3-30B-A3B architecture: 128 experts, top-8, 48 layers), trained with agentic continual…

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +2
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
Served with vLLM, task not statedCommunity model

MiroThinker-1.7-mini

miromind-ai/MiroThinker-1.7-mini

MiroThinker-1.7-mini, a deep-research agent model: Qwen3-30B-A3B (30B-parameter mixture of experts, 3B active per token: 128 experts, top-8, 48 layers) trained for long-horizon search, browsing and tool use (up to 300 tool calls per task).

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +2
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
LLM (inferred)Community model

Ornith-1.5-122B

ornith-ai/Ornith-1.5-122B

Ornith-1.5-122B, a 122B-parameter mixture-of-experts model with 10B parameters active per token (256 experts, top-8 plus a shared expert; 48 layers mixing Gated DeltaNet linear attention with gated full attention; the Qwen3.5-122B-A10B…

Runs on
BH 4xP150, BH QuietBox 2
Speed
133 tok/s230 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
LLM (inferred)Community model

Ornith-1.5-35B-A3B

ornith-ai/Ornith-1.5-35B-A3B

Ornith-1.5-35B-A3B, a 35B-parameter mixture-of-experts model with 3B parameters active per token (256 experts, top-8 plus a shared expert; 40 layers mixing Gated DeltaNet linear attention with gated full attention) and a vision encoder,…

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +3
Speed
220 tok/s118 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
Served with vLLM, task not statedCommunity model

QUEST-35B-RL

osunlp/QUEST-35B-RL

QUEST-35B-RL, a deep-research agent model: Qwen3.5-35B-A3B (35B-parameter mixture of experts, 3B active per token: 256 experts, top-8 plus a shared expert; 40 layers mixing Gated DeltaNet linear attention with gated full attention; vision…

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +3
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
LLM (inferred)Community model

Qwen3.5-122B-A10B

Qwen/Qwen3.5-122B-A10B

Qwen3.5-122B-A10B, a 122B-parameter mixture-of-experts model with 10B parameters active per token (256 experts, top-8 plus a shared expert; 48 layers mixing Gated DeltaNet linear attention with gated full attention) and a vision encoder,…

Runs on
BH 4xP150, BH QuietBox 2
Speed
131 tok/s216 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle
VLMCommunity model

Qwen3.8-Flash-Next

Qwen/Qwen3.8-Flash-Next

Qwen3.8-Flash-Next, a 125B-parameter mixture-of-experts model with about 6B parameters active per token (48 layers mixing gated delta-net and sparse attention, 512 routed experts, top-10 plus one shared expert, a 51B-parameter n-gram…

Runs on
BH 4xP150, BH LoudBox, BH QuietBox 2
Speed
1.0 tok/s1 ms 4 chips
Status
Not in the release spec
tt launch
7 clients
5 tt-model bundles
Served with vLLM, task not statedCommunity model

SenseNova-6.8-Code2Video

sensenova/SenseNova-6.8-Code2Video

Published as 1 tt-model bundle by episod.

Runs on
p150x2
Status
Not in the release spec
tt launch
2 clients
1 tt-model bundle
Text rankingCommunity model

Qwen3-Reranker-4B

Qwen/Qwen3-Reranker-4B

Qwen3-Reranker-4B, a text reranker for 100+ languages and code: it scores how well a document answers a query by reading logit("yes") - logit("no") at the end of the model card's prompt, served as a Cohere / Jina / vLLM-style /v1/rerank…

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +2
Status
Not in the release spec
tt launch
None
1 tt-model bundle
EmbeddingCommunity model

Qwen3-VL-Embedding-8B

Qwen/Qwen3-VL-Embedding-8B

Qwen3-VL-Embedding-8B, a multimodal embedding model: text, images, screenshots, video, or a mix, map to one L2-normalised 4096-dimensional vector in a shared space (Matryoshka dimensions down to 64), served as an OpenAI-style…

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +2
Status
Not in the release spec
tt launch
None
1 tt-model bundle
Text rankingCommunity model

Qwen3-VL-Reranker-8B

Qwen/Qwen3-VL-Reranker-8B

Qwen3-VL-Reranker-8B, a multimodal reranker: it scores how well a document answers a query, where either side can be text, images, screenshots, video or a mix.

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +2
Status
Not in the release spec
tt launch
None
1 tt-model bundle
Decision modelCommunity model

clef

Cloudflare/clef

Clef is a 27B-parameter multimodal decision model from Cloudflare: a Qwen3.8-27B backbone (64 layers, 48 Gated DeltaNet and 16 full-attention, hidden size 5120) with its 27-block vision tower, and a 65M-parameter joint schema head.

Runs on
p150x2
Status
Not in the release spec
tt launch
None
2 tt-model bundles
Decision modelCommunity model

clm-v0.1-8b

Qwen/Qwen3-8B

CLM-v0.1-8B is a System One verifier and ranker: a frozen Qwen3-8B encoder (36 layers, last-token pooling) with two 9.4M-parameter MLP projection heads (4096-1536-1536-512), a state head and an action head, trained with a bidirectional…

Runs on
BH 4xP150, p150
Status
Not in the release spec
tt launch
None
1 tt-model bundle
LLMOfficial

gemma-4-26B-A4B-it

google/gemma-4-26B-A4B-it

Listed in tt-inference-server on 1 hardware type; best status Functional. 1 tt-model bundle also published.

Runs on
BH 4xP150, BH QuietBox 2, p150 +1
Speed
≥ 22 tok/s≤ 240 ms BH QuietBox 2
Status
Functional
tt launch
7 clients
4B parameters1 tt-model bundle
LLMCommunity model

gpt-oss-20b

openai/gpt-oss-20b

gpt-oss-20b, OpenAI's 21B-parameter mixture-of-experts reasoning model (3.6B active parameters), served with vLLM for chat, reasoning and function calling.

Runs on
BH 4xP150, BH LoudBox, p150 +1
Speed
48 tok/s209 ms 1 chip
Status
Not in the release spec
tt launch
7 clients
4 tt-model bundles
LLMCommunity model

Laguna-XS-2.1

poolside/Laguna-XS-2.1

Laguna-XS-2.1, poolside's 33B-parameter mixture-of-experts coding model (3B active parameters), served with vLLM with tool calling and separated reasoning output.

Runs on
BH 4xP150, p150x2
Speed
20 tok/s215 ms 2 chips
Status
Not in the release spec
tt launch
7 clients
1 tt-model bundle