Models

Experimental

Models whose best status in the release spec is Experimental.

12 models
LLMOfficial

AFM-4.5B

arcee-ai/AFM-4.5B

Listed in tt-inference-server on 2 hardware types; best status Experimental.

Runs on
WH LoudBox/QuietBox, n300
Status
Experimental
tt launch
2 clients
4B parameters
EmbeddingOfficial

bge-large-en-v1.5

BAAI/bge-large-en-v1.5

Listed in tt-inference-server on 4 hardware types; best status Experimental.

Runs on
WH Galaxy, WH LoudBox/QuietBox, n150 +1
Status
Experimental
tt launch
None
EmbeddingOfficial

bge-m3

BAAI/bge-m3

Listed in tt-inference-server on 1 hardware type; best status Experimental.

Runs on
BH QuietBox 2
Status
Experimental
tt launch
None
LLMOfficial

DeepSeek-R1-0528

deepseek-ai/DeepSeek-R1-0528

Listed in tt-inference-server on 3 hardware types; best status Experimental.

Runs on
Dual WH Galaxy, Quad WH Galaxy, WH Galaxy
Status
Experimental
tt launch
7 clients
LLMOfficial

diffusiongemma-26B-A4B-it

google/diffusiongemma-26B-A4B-it

Listed in tt-inference-server on 1 hardware type; best status Experimental.

Runs on
BH QuietBox 2
Status
Experimental
tt launch
2 clients
4B parameters
VLMOfficial

gemma-3-27b-it

google/gemma-3-27b-it

Listed in tt-inference-server on 1 hardware type; best status Experimental.

Runs on
WH Galaxy
Speed
≥ 4.3 tok/s≤ 760 ms WH Galaxy
Status
Experimental
tt launch
2 clients
27B parameters
LLMOfficial

gpt-oss-120b

openai/gpt-oss-120b

Listed in tt-inference-server on 4 hardware types; best status Experimental. 3 tt-model bundles also published.

Runs on
BH 4xP150, BH Galaxy, BH LoudBox +3
Speed
≥ 2.7 tok/s≤ 510 ms BH QuietBox 2
Status
Experimental
tt launch
7 clients
120B parameters3 tt-model bundles
EmbeddingOfficial

Qwen3-Embedding-0.6B

Qwen/Qwen3-Embedding-0.6B

Listed in tt-inference-server on 1 hardware type; best status Experimental.

Runs on
BH QuietBox 2
Status
Experimental
tt launch
None
EmbeddingOfficial

Qwen3-Embedding-4B

Qwen/Qwen3-Embedding-4B

Listed in tt-inference-server on 1 hardware type; best status Experimental.

Runs on
BH QuietBox 2
Status
Experimental
tt launch
None
4B parameters
EmbeddingOfficial

Qwen3-Embedding-8B

Qwen/Qwen3-Embedding-8B

Listed in tt-inference-server on 4 hardware types; best status Experimental.

Runs on
WH Galaxy, WH LoudBox/QuietBox, n150 +1
Status
Experimental
tt launch
None
8B parameters
LLMOfficial

Qwen3.6-27B

Qwen/Qwen3.6-27B

Listed in tt-inference-server on 1 hardware type; best status Experimental. 1 tt-model bundle also published.

Runs on
BH 4xP150, BH QuietBox 2
Status
Experimental
tt launch
7 clients
27B parameters1 tt-model bundle
Text-to-speechOfficial

speecht5_tts

microsoft/speecht5_tts

Listed in tt-inference-server on 2 hardware types; best status Experimental.

Runs on
BH QuietBox 2, p150
Status
Experimental
tt launch
None