Models

Models

132 models, listed in tt-inference-server's release spec (commit 2db98e38c) or published as tt-model bundles. Every list shows Complete models first, then Functional, then Experimental, then community bundles. Each model has its own page with the commands to install and run it.

Models marked Community model are tt-model bundles published by their owners and are not in tt-inference-server's release spec. Tenstorrent has not reviewed them. Serve at your own risk.

Collections

Ready-made lists.

All models132 Runs on a single card83 Official model support48 Community-supported models91 Newest tt-model bundles20

Families

Models grouped by the start of their name. Only families with two or more models are listed.

Qwen20 Llama9 FLUX4 gemma4 Ornith4 DeepSeek3 GR00T3 lidar3 llm3 Stable Diffusion3 bge2 GLM2 gpt-oss2 Laguna2 laya2 MiniMax2 Mistral2 RLDX2 tensorrt2 Wan2

Kinds

What the model does, as tt-inference-server or the bundle's card says.

LLM56 Image generation11 Object detection11 Robotics10 CNN6 Embedding6 Decision model5 Text-to-speech5 Depth and 3D geometry4 Computer vision3 Image segmentation3 Speech-to-text3 Text to audio3 Video generation3 VLM2 Image text to video1

Hardware

Where a model runs. Names are tt-inference-server's own (DeviceTypes.to_product_str).

n15019 n30020 WH LoudBox/QuietBox30 p1007 p15062 BH 4xP15030 BH LoudBox16 BH P30012 BH QuietBox 245 BH Galaxy6 WH Galaxy25 Dual WH Galaxy1 Quad WH Galaxy1 GPU2 n150x321 p100a7 p150x213

Status

Best status a model has in tt-inference-server's release spec.

Complete24 Functional12 Experimental12

Hardware names

tt-inference-server's release spec names a device with a key such as GALAXY_T3K. This is the product name it gives each key (workflows/workflow_types.py, DeviceTypes.to_product_str), and the mesh name it uses.

Device keyProductMesh
E150e150E150
N150n150N150
N150X44xn150N150x4
N300n300N300
T3KWH LoudBox/QuietBoxT3K
P100p100P100
P150p150P150
P150X4BH 4xP150P150x4
P150X8BH LoudBoxP150x8
P300BH P300P300
P300X2BH QuietBox 2P300x2
BLACKHOLE_GALAXYBH GalaxyBH-Galaxy
GALAXYWH GalaxyTG
GALAXY_T3KWH GalaxyT3K
DUAL_GALAXYDual WH Galaxy(8,8)
QUAD_GALAXYQuad WH Galaxy(8,16)
SUPER_CLUSTERBH Super-ClusterSuper-Cluster