Tools

• tt-smi

The Tenstorrent System Management Interface (TT-SMI) is a command-line tool that provides a simple way to interact with Tenstorrent devices, collect telemetry, and display device and firmware information.

• ttnn-visualizer

TTNN-Visualizer is an interactive tool for visualizing and analyzing model execution on Tenstorrent hardware. It provides detailed insights through graphs, memory plots, tensor and buffer views, operation flow diagrams, and multi-instance support via file or SSH report loading.

For more information, check out the Getting Started guide and our tutorial: TTNN-Visualizer Tutorial.

• vllm

A high-throughput and memory-efficient inference and serving engine for Large Language Models (LLMs) on Tenstorrent hardware.

• tracy profiler

Tracy is a real-time, high-performance tracing tool designed for analyzing and visualizing the execution of deep learning models and operations on Tenstorrent hardware.

For detailed instructions on profiling TT-NN operations, refer to the Profiling TT-NN Operations guide.