gpt-oss

Models whose name starts with gpt-oss.

Community models are tt-model bundles published by their owners and are not in tt-inference-server's release spec. Tenstorrent has not reviewed them. Serve at your own risk.

2 models Filter

LLMOfficial

gpt-oss-120b

openai/gpt-oss-120b

Listed in tt-inference-server on 4 hardware types; best status Experimental. 3 tt-model bundles also published.

Runs on: BH 4xP150, BH Galaxy, BH LoudBox +3
Speed: ≥ 2.7 tok/s≤ 510 ms BH QuietBox 2
Status: Experimental
tt launch: 7 clients

120B parameters3 tt-model bundles

LLMCommunity model

gpt-oss-20b

openai/gpt-oss-20b

gpt-oss-20b, OpenAI's 21B-parameter mixture-of-experts reasoning model (3.6B active parameters), served with vLLM for chat, reasoning and function calling.

Runs on: BH 4xP150, BH LoudBox, p150 +1
Speed: 48 tok/s209 ms 1 chip
Status: Not in the release spec
tt launch: 7 clients

4 tt-model bundles