gemma
Models whose name starts with gemma.
Community models are tt-model bundles published by their owners and are not in tt-inference-server's release spec. Tenstorrent has not reviewed them. Serve at your own risk.
LLMOfficial
gemma-4-12B-it
google/gemma-4-12B-it
Listed in tt-inference-server on 2 hardware types; best status Complete. 1 tt-model bundle also published.
- Runs on
- BH Galaxy, BH QuietBox 2, p100 +1
- Status
- Complete
- tt launch
- 7 clients
12B parameters1 tt-model bundle
LLMOfficial
gemma-4-31B-it
google/gemma-4-31B-it
Listed in tt-inference-server on 2 hardware types; best status Complete.
- Runs on
- BH Galaxy, BH QuietBox 2
- Status
- Complete
- tt launch
- 7 clients
31B parameters
VLMOfficial
gemma-3-27b-it
google/gemma-3-27b-it
Listed in tt-inference-server on 1 hardware type; best status Experimental.
- Runs on
- WH Galaxy
- Speed
- ≥ 4.3 tok/s≤ 760 ms WH Galaxy
- Status
- Experimental
- tt launch
- 2 clients
27B parameters
LLMCommunity model
gemma-4-26B-A4B-it
google/gemma-4-26B-A4B-it
Gemma 4 26B A4B instruction-tuned, a 25.2B-parameter mixture-of-experts model (3.8B active parameters; 30 layers; 128 experts with 8 active plus 1 shared), served with vLLM for chat, reasoning and tool calling on text input.
- Runs on
- BH 4xP150, p150, p150x2
- Speed
- 37 tok/s175 ms 1 chip
- Status
- Not in the release spec
- tt launch
- 7 clients
1 tt-model bundle
No model in this list matches the filter.