DFloat11-TT
communityDFloat11 lossless LLM weight compression ported to Blackhole. Huffman-codes only the exponent field of BFloat16 weights, cutting them to about 70% of their size with bit-for-bit identical outputs, with a C++ extension built against tt-metal, a compressor and an on-device evaluation path.
Works on
blackhole