Open in tt-awesome →

ttWKV7

community
by Martin Chang · C++ · 2⭐ ·

A standalone tt-metal demo and test bench for the RWKV-7 (WKV7) state recurrence on Wormhole, built with a GGML backend in mind. Two compute kernels cover the domain: a chunked-parallel DPLR matmul path for any sequence length with on-chip chunk carry, and a sequential per-token decode path for L <= 32 that is faster for large-batch token generation. The host runner validates both against a CPU oracle by PCC/NMSE and benchmarks them over a sequence/batch grid.

📦 Repo
rwkv wkv7 operator tt-metal ggml recurrent cpp
wormhole