Tools

Hardware Monitoring

  • TT-SMI

    TT-SMI is a command-line tool for interacting with Tenstorrent devices, collecting telemetry, and displaying device and firmware information. Pre-installed with the Tenstorrent software stack.

  • TT-Toplike

    TT-Toplike is a real-time terminal hardware monitor for Tenstorrent silicon. It reads power, temperature, current, and ARC firmware health from the chips and drives visualizations directly from that telemetry: a live table, Starfield, Memory Castle, Memory Flow, and Arcade modes.

Model Serving & Inference

  • TT-Inference-Server

    TT-Inference-Server is the primary way to deploy models for serving inference on Tenstorrent hardware. It manages Docker containers, model downloads, and serving configuration, and provides an OpenAI-compatible API endpoint. The repository is the canonical reference for which models are validated and supported on each hardware generation.

  • vLLM

    Tenstorrent’s vLLM fork is the high-throughput LLM serving engine used by TT-Inference-Server for production inference.

  • TT-Studio

    TT-Studio is a web interface that wraps TT-Inference-Server with a point-and-click model deployment flow. It is the fastest way for new users to deploy and interact with a model without using the command line.

System Configuration

  • TT-Topology

    TT-Topology is a command-line utility for configuring Ethernet routing on multi-card systems. Required on TT-QuietBox™ and TT-LoudBox™ Wormhole-based systems before running networked inference.

Analysis & Visualization

  • TT-NN Visualizer

    TT-NN Visualizer is an interactive tool for analyzing model execution on Tenstorrent hardware: graphs, memory plots, tensor and buffer views, operation flow diagrams, and multi-instance support via file or SSH report loading.

  • Model-Explorer

    Model Explorer provides a hierarchical view of model graphs, organizing operations into nested layers that you can expand or collapse.

Learning

  • TT-VSCode-Toolkit

    TT-VSCode-Toolkit is a guided learning environment for Tenstorrent software development inside VS Code. It includes 40+ lessons covering inference, agents, video generation, kernel programming, and CS fundamentals, all validated on Tenstorrent hardware.

Community

  • TT-Awesome

    TT-Awesome is a community-curated catalog of apps, demos, libraries, and experiments built for Tenstorrent hardware.

Note

No hardware yet? console.tenstorrent.com lets you run LLM inference and image and video generation in the browser, backed by Tenstorrent hardware.

Important

For tools specific to individual components of the Tenstorrent software stack, see: