Models

mochi-1-preview

Listed in tt-inference-server on 3 hardware types; best status Complete.

In tt-inference-server

HardwareEngine and implementationStatusContextUsersBuildSupport page
BH LoudBox
P150X8
media
tt-transformers
Complete 64K 1
tt-metal 555f240
Image ghcr.io/tenstorrent/tt-media-inference-server:0.10.0-555f240
Open
WH Galaxy
GALAXY
media
tt-transformers
Complete 64K 1
tt-metal 555f240
Image ghcr.io/tenstorrent/tt-media-inference-server:0.10.0-555f240
Open
WH LoudBox/QuietBox
T3K
media
tt-transformers
Complete 64K 1
tt-metal 555f240
Image ghcr.io/tenstorrent/tt-media-inference-server:0.10.0-555f240
Open

Status, context and users are copied from tt-inference-server's release spec (commit 2db98e38c, release 0.25.0). Context is the longest prompt plus reply the entry allows. Users is its highest concurrency. Each row carries its own code link, tt-metal and vLLM commits and image, because they differ between hardware. Nothing on this page is measured.

tt-model bundles

No tt-model bundle has been published for this model.

Details

KindVideo generation (from tt-inference-server model type)
Familymochi (from the start of the name)
Implementationtt-transformers
Disk needed60 GB
RAM needed32 GB
Listed bytt-inference-server