A 24B-parameter mixture-of-experts model with 2B active parameters per token: a hybrid decoder of 30 gated short-convolution layers and 10 grouped-query attention layers.
Community model. It is published as a tt-model bundle and is not in tt-inference-server's release spec. Tenstorrent has not reviewed the model or its bundle. Serve at your own risk.
From tt-model search --catalog and each bundle's manifest (tt-model info). A bundle lists every hardware profile its manifest defines. Each bundle is published by its owner, and Tenstorrent has not reviewed it. Serve at your own risk.
Details
Kind
LLM (an inference: The bundle's card calls it an instruct model for chat, tool calling and reasoning.)