gemma-3-27b-it

Listed in tt-inference-server on 1 hardware type; best status Experimental.

In tt-inference-server

Hardware	Engine and implementation	Status	Context	Users	Build	Support page
WH Galaxy `GALAXY`	vLLM tt-transformers	Experimental	128K	32	Code: https://github.com/tenstorrent/tt-metal/tree/0b10c51/models/tt_transformers tt-metal `0b10c51` vLLM `3499ffa` Image `ghcr.io/tenstorrent/tt-inference-server/vllm-tt-metal-src-release-ubuntu-22.04-amd64:0.9.0-0b10c51-3499ffa`	Open

Status, context and users are copied from tt-inference-server's release spec (commit 2db98e38c, release 0.25.0). Context is the longest prompt plus reply the entry allows. Users is its highest concurrency. Each row carries its own code link, tt-metal and vLLM commits and image, because they differ between hardware. Nothing on this page is measured.

tt-model bundles

No tt-model bundle has been published for this model.

Details

Kind	VLM (from tt-inference-server model type)
Parameters	27B
Family	gemma (from the start of the name)
Implementation	tt-transformers
Disk needed	74 GB
RAM needed	67.5 GB
Listed by	tt-inference-server