LLM
Official
Kolibri-1-BF16
Listed in tt-inference-server on 1 hardware type; best status Experimental.
In tt-inference-server
| Hardware | Engine and implementation | Status | Context | Users | Build | Support page |
|---|---|---|---|---|---|---|
BH QuietBox 2P300X2 |
vLLM kolibri-1-qb2 |
Experimental | 256K | 32 | Code: https://github.com/tenstorrent/tt-metal/tree/09acccb/models/autoports/aleph_alpha_kolibri_1_bf16 tt-metal 09acccbvLLM 6098002Image ghcr.io/tenstorrent/tt-inference-server/vllm-tt-metal-src-release-ubuntu-22.04-amd64:0.26.0-09acccb-6098002 |
Open |
Status, context and users are copied from tt-inference-server's release spec (commit 0ad0f4be9, release 0.26.1). Context is the longest prompt plus reply the entry allows. Users is its highest concurrency. Each row carries its own code link, tt-metal and vLLM commits and image, because they differ between hardware. Nothing on this page is measured.
tt-model bundles
No tt-model bundle has been published for this model.
Details
| Kind | LLM (from tt-inference-server model type) |
| Family | Kolibri (from the start of the name) |
| Implementation | kolibri-1-qb2 |
| Disk needed | 180 GB |
| RAM needed | 128 GB |
| Reasoning parser | kolibri1 |
| Listed by | tt-inference-server |