CNN Official

vit

Listed in tt-inference-server on 2 hardware types; best status Complete.

In tt-inference-server

Hardware	Engine and implementation	Status	Context	Users	Build	Support page
n150 `N150`	forge tt-transformers	Complete	64K	1	Code: https://github.com/tenstorrent/tt-metal/tree/079a2c2/models/tt_transformers tt-metal `079a2c2` Image `ghcr.io/tenstorrent/tt-media-inference-server-forge:0.13.0-079a2c2`	Open
n300 `N300`	forge tt-transformers	Complete	64K	1	Code: https://github.com/tenstorrent/tt-metal/tree/079a2c2/models/tt_transformers tt-metal `079a2c2` Image `ghcr.io/tenstorrent/tt-media-inference-server-forge:0.13.0-079a2c2`	Open

Status, context and users are copied from tt-inference-server's release spec (commit 2db98e38c, release 0.25.0). Context is the longest prompt plus reply the entry allows. Users is its highest concurrency. Each row carries its own code link, tt-metal and vLLM commits and image, because they differ between hardware. Nothing on this page is measured.

tt-model bundles

No tt-model bundle has been published for this model.

Details

Kind	CNN (from tt-inference-server model type)
Family	vit (from the start of the name)
Implementation	tt-transformers
Disk needed	15 GB
RAM needed	6 GB
Listed by	tt-inference-server