gemma
Models whose name starts with gemma.
LLMOfficial
gemma-4-12B-it
google/gemma-4-12B-it
Listed in tt-inference-server on 2 hardware types; best status Complete. 1 tt-model bundle also published.
- Runs on
- BH Galaxy, BH QuietBox 2, p100 +1
- Speed
- ≥ 22 tok/s≤ 144 ms BH Galaxy
- Status
- Complete
- tt launch
- 7 clients
12B parameters1 tt-model bundle
LLMOfficial
gemma-4-31B-it
google/gemma-4-31B-it
Listed in tt-inference-server on 2 hardware types; best status Complete.
- Runs on
- BH Galaxy, BH QuietBox 2
- Speed
- ≥ 13 tok/s≤ 236 ms BH Galaxy
- Status
- Complete
- tt launch
- 7 clients
31B parameters
LLMOfficial
gemma-4-26B-A4B-it
google/gemma-4-26B-A4B-it
Listed in tt-inference-server on 1 hardware type; best status Functional. 1 tt-model bundle also published.
- Runs on
- BH 4xP150, BH QuietBox 2, p150 +1
- Speed
- ≥ 22 tok/s≤ 240 ms BH QuietBox 2
- Status
- Functional
- tt launch
- 7 clients
4B parameters1 tt-model bundle
VLMOfficial
gemma-3-27b-it
google/gemma-3-27b-it
Listed in tt-inference-server on 1 hardware type; best status Experimental.
- Runs on
- WH Galaxy
- Speed
- ≥ 4.3 tok/s≤ 760 ms WH Galaxy
- Status
- Experimental
- tt launch
- 2 clients
27B parameters
No model in this list matches the filter.