Models
CNN Official

yolox_nano

yolox_nano

Listed in tt-inference-server on 1 hardware type; best status Complete.

In tt-inference-server

HardwareEngine and implementationStatusContextUsersBuildSupport page
p150
P150
forge
tt-transformers
Complete 64K 1
tt-metal c49bb76
Image ghcr.io/tenstorrent/tt-media-inference-server-forge:0.18.0-c49bb76
Open

Status, context and users are copied from tt-inference-server's release spec (commit 2db98e38c, release 0.25.0). Context is the longest prompt plus reply the entry allows. Users is its highest concurrency. Each row carries its own code link, tt-metal and vLLM commits and image, because they differ between hardware. Nothing on this page is measured.

tt-model bundles

No tt-model bundle has been published for this model.

Details

KindCNN (from tt-inference-server model type)
Familyyolox (from the start of the name)
Implementationtt-transformers
Disk needed15 GB
RAM needed6 GB
Listed bytt-inference-server