Models

Embedding

Models of this kind. A tt-inference-server model's kind is its model type. A tt-model bundle's kind is the task tag on its card.

Community models are tt-model bundles published by their owners and are not in tt-inference-server's release spec. Tenstorrent has not reviewed them. Serve at your own risk.

7 models
EmbeddingOfficial

bge-large-en-v1.5

BAAI/bge-large-en-v1.5

Listed in tt-inference-server on 4 hardware types; best status Experimental.

Runs on
WH Galaxy, WH LoudBox/QuietBox, n150 +1
Status
Experimental
tt launch
None
EmbeddingOfficial

bge-m3

BAAI/bge-m3

Listed in tt-inference-server on 1 hardware type; best status Experimental.

Runs on
BH QuietBox 2
Status
Experimental
tt launch
None
EmbeddingOfficial

Qwen3-Embedding-0.6B

Qwen/Qwen3-Embedding-0.6B

Listed in tt-inference-server on 1 hardware type; best status Experimental.

Runs on
BH QuietBox 2
Status
Experimental
tt launch
None
EmbeddingOfficial

Qwen3-Embedding-4B

Qwen/Qwen3-Embedding-4B

Listed in tt-inference-server on 1 hardware type; best status Experimental.

Runs on
BH QuietBox 2
Status
Experimental
tt launch
None
4B parameters
EmbeddingOfficial

Qwen3-Embedding-8B

Qwen/Qwen3-Embedding-8B

Listed in tt-inference-server on 4 hardware types; best status Experimental.

Runs on
WH Galaxy, WH LoudBox/QuietBox, n150 +1
Status
Experimental
tt launch
None
8B parameters
EmbeddingCommunity model

embeddinggemma-2

google/embeddinggemma-2

EmbeddingGemma 2, a multimodal embedding model.

Runs on
p150
Status
Not in the release spec
tt launch
None
1 tt-model bundle
EmbeddingCommunity model

Qwen3-VL-Embedding-8B

Qwen/Qwen3-VL-Embedding-8B

Qwen3-VL-Embedding-8B, a multimodal embedding model: text, images, screenshots, video, or a mix, map to one L2-normalised 4096-dimensional vector in a shared space (Matryoshka dimensions down to 64), served as an OpenAI-style…

Runs on
BH 4xP150, BH P300, BH QuietBox 2 +2
Status
Not in the release spec
tt launch
None
1 tt-model bundle