SmolLM2-135M-Instruct
SmolLM2-135M-Instruct, a 135M-parameter Llama-architecture decoder-only transformer, served with vLLM.
Community model. It is published as a tt-model bundle and is not in tt-inference-server's release spec. Tenstorrent has not reviewed the model or its bundle. Serve at your own risk.
tt-model bundles
| Bundle | Hardware | Served with | Context | Pushed | |
|---|---|---|---|---|---|
| stisiTT/smollm2-135m-instruct-p150 | p100, p150 | vllm-plugin | 8K | 2026-10-21 |
From tt-model search --catalog and each bundle's manifest (tt-model info). A bundle lists every hardware profile its manifest defines. Each bundle is published by its owner, and Tenstorrent has not reviewed it. Serve at your own risk.
Details
| Kind | LLM (an inference: The bundle's card calls it a decoder-only chat model.) |
| Family | SmolLM (from the start of the name) |
| License (bundle cards) | apache-2.0 |
| Listed by | tt-model bundle |