Lab Exercises

• Lab 1: Single Core Matrix Multiplication
  • Introduction
    • Basic Algorithm
  • Row-Major Memory Layout
    • Cache-Friendly Access Patterns
      • Implications for Matrix Multiplication
  • Linear Transformation and Computational Flexibility
  • Loop Tiling
    • Simple Tiling Example
      • Original Doubly Nested Loop
      • Tiled Version
    • Exercise 1: Tiled Matrix Multiplication
  • Introduction to Tenstorrent Architecture
    • Tile-Based Architecture
      • Memory Layout and Tiling
  • TT-Metalium Programming Model
  • Example TT-Metalium Program
    • Exercise 2: Running the Example Program
    • Program Description
      • Kernel Types and Data Flow
      • Kernel Creation and Configuration
      • Reader Kernel Code
      • Compute Kernel Code
      • Writer Kernel Code
    • Example Program Summary
  • Kernel Compilation and Execution
    • Exercise 3: Observing JIT Compile Errors
  • Debug Facilities in TT-Metalium
    • Debug Print API
      • Printing a Tile in a Dataflow Kernel
      • Caveats and Best Practices
      • Exercise 4: Using DPRINT to Debug a Kernel
    • Debugging Hangs using Stack Traces
      • tt-triage Dependencies
      • Exercise 5: Using tt-triage to Debug a Hang
    • Device Performance Profiling
      • Exercise 6: Using Device Profiling to Profile Kernels
  • Matrix Multiplication in TT-Metalium
    • Exercise 7: Implementing Matrix Multiplication in TT-Metalium
  • Conclusion
  • Troubleshooting and Additional Resources