Mistral
Models whose name starts with Mistral.
Community models are tt-model bundles published by their owners and are not in tt-inference-server's release spec. Tenstorrent has not reviewed them. Serve at your own risk.
LLMOfficial
Mistral-7B-Instruct-v0.3
mistralai/Mistral-7B-Instruct-v0.3
Listed in tt-inference-server on 3 hardware types; best status Complete.
- Runs on
- WH LoudBox/QuietBox, n150, n300
- Speed
- ≥ 35 tok/s≤ 156 ms n150
- Status
- Complete
- tt launch
- 2 clients
7B parameters
LLM (inferred)Community model
Mistral-Small-4-119B-2603
mistralai/Mistral-Small-4-119B-2603
Published as 1 tt-model bundle by ndaly.
- Runs on
- BH QuietBox 2
- Status
- Not in the release spec
- tt launch
- 2 clients
1 tt-model bundle
No model in this list matches the filter.