llm

Models whose name starts with llm.

Community models are tt-model bundles published by their owners and are not in tt-inference-server's release spec. Tenstorrent has not reviewed them. Serve at your own risk.

3 models Filter

LLMCommunity model

llm-jp-4-33b-thinking

llm-jp/llm-jp-4-33b-thinking

llm-jp/llm-jp-4-33b-thinking (LLM-jp-4 33B, thinking) served by vLLM and the Tenstorrent vLLM plugin on a QuietBox 2 (two p300c boards, four Blackhole chips, mesh P300x2).

Runs on: BH QuietBox 2
Speed: 20 tok/s342 ms 4 chips
Status: Not in the release spec
tt launch: 2 clients

1 tt-model bundle

LLMCommunity model

llm-jp-4-8b-thinking

llm-jp/llm-jp-4-8b-thinking

llm-jp/llm-jp-4-8b-thinking (LLM-jp-4 8B, thinking) served by vLLM and the Tenstorrent vLLM plugin on one Blackhole P150 chip (p150a).

Runs on: p150
Speed: 22 tok/s311 ms 1 chip
Status: Not in the release spec
tt launch: 2 clients

1 tt-model bundle

LLMCommunity model

llm-jp-4.1-8b-thinking

llm-jp/llm-jp-4.1-8b-thinking

llm-jp/llm-jp-4.1-8b-thinking (LLM-jp-4.1 8B, thinking) served by vLLM and the Tenstorrent vLLM plugin on one Blackhole P150 chip (p150a).

Runs on: p150
Status: Not in the release spec
tt launch: 7 clients

1 tt-model bundle