LLM kind inferred
Community model
Kimi-Linear-48B-A3B-Instruct
Published as 1 tt-model bundle by jashansinghTT.
Community model. It is published as a tt-model bundle and is not in tt-inference-server's release spec. Tenstorrent has not reviewed the model or its bundle. Serve at your own risk.
tt-model bundles
From tt-model search --catalog and each bundle's manifest (tt-model info). A bundle lists every hardware profile its manifest defines. Each bundle is published by its owner, and Tenstorrent has not reviewed it. Serve at your own risk.
Details
Kind LLM (an inference: An instruct language model; the bundle names a kimi_k2 tool-call parser.)
Family Kimi (from the start of the name) Tool-call parser kimi_k2
Listed by tt-model bundle
Install and run
Download the weights and the bundle
tt model pull jashansinghTT/kimi-linear-48b-a3b-instruct-blackhole
Copy
Not reviewed by Tenstorrent. Serve at your own risk.
Serve it on this machine
tt serve jashansinghTT/kimi-linear-48b-a3b-instruct-blackhole
Copy
A tt-model bundle, so tt serve runs it through tt-model. If a bundle needs hardware you do not have, tt says so.
Connect a client with tt launch
Serve the model first, then run one of these. Only clients that work with this model are listed.
Terminal. Tool calling: kimi_k2
tt launch opencode --model moonshotai/Kimi-Linear-48B-A3B-Instruct
Copy
Terminal. Tool calling: kimi_k2
tt launch pi --model moonshotai/Kimi-Linear-48B-A3B-Instruct
Copy
Terminal. Tool calling: kimi_k2
tt launch aider --model moonshotai/Kimi-Linear-48B-A3B-Instruct
Copy
Terminal. Tool calling: kimi_k2
tt launch qwencode --model moonshotai/Kimi-Linear-48B-A3B-Instruct
Copy
Terminal. Tool calling: kimi_k2
tt launch hermes --model moonshotai/Kimi-Linear-48B-A3B-Instruct
Copy
Web service. Any chat model
tt launch openwebui --model moonshotai/Kimi-Linear-48B-A3B-Instruct
Copy
Web service. Any chat model
tt launch anythingllm --model moonshotai/Kimi-Linear-48B-A3B-Instruct
Copy
Terminal clients need a tool-call parser. Open WebUI and AnythingLLM take any chat model. The rule is tt-cli's (tt launch). This model is not in tt's catalog, so tt warns instead of checking. The listing comes from the bundle's manifest, which says it is served with vLLM and names the kimi_k2 parser.