Open in tt-awesome →

grayskull-attention

affiliated
by moritztng · TeX · MIT · 38⭐ ·

FlashAttention-style attention kernel implemented entirely in on-chip SRAM on the Tenstorrent Grayskull chip using TT-Metalium. Pioneering work in low-level attention on TT hardware.

📦 Repo
attention grayskull metalium sram kernel
grayskull