Open in tt-awesome →

ferrite

community
by alkinun · Python · Apache-2.0 · 2⭐ ·

A from-scratch userspace software stack for Tenstorrent Blackhole in about 1,900 lines of Python. It talks to the card over PCIe, loads firmware onto Tensix cores, compiles tensor expressions to Tensix instructions, and runs and serves GPT-2, SmolLM and Llama-family models, with tinygrad integration and training examples. It does not use the Tenstorrent kernel driver, tt-umd, tt-metal or LLK beyond the card firmware, and can run against the TTSIM simulator.

📦 Repo
blackhole runtime tensor-compiler tensix pcie llm-inference tinygrad training userspace-driver
blackhole ttsim