Tools

Note

Tools are only fully supported on source builds.

• Debug Checkpoints

Debug checkpoints provide synchronized inspection points for fused kernels, where all RISCs on a core halt together and dump circular buffer state.

• Device Debug Print

Device print is the debug tool for printing formatted messages from kernels to the host terminal or a log file. DPRINT(...) is the recommended user-facing macro.

• Watcher

The Watcher is a thread that monitors the status of the TT device to help with debug.

• Tracy Profiler

Tracy profiler is for profiling device-side RISCV code and host-side python and C++ code.

• Device Program Profiler

Device program profiler brings visibility to execution of device side programs by providing duration counts on marked portions of the code.

• Lightweight Kernel Asserts

Lightweight kernel asserts provide a mechanism for assertion checks within the kernel.

• LLK Asserts

LLK asserts provide validation checks within the low-level kernel library infrastructure code.

• Inspector

The Inspector is a tool that provides insights into Metal host runtime.

• tt-triage

The tt-triage is a collection of Python scripts for analyzing and debugging Metal workload.

• NOC Debug Dump

NOC debug dump collects NOC traces from the device to identify potential kernel programming issues.

• tt-smi

TT-SMI is a command line utility to interact with all Tenstorrent devices on host.