Introduction

The TT-Forge FE is a graph compiler designed to optimize and transform computational graphs for deep learning models, enhancing their performance and efficiency.

Built on top of the TT-MLIR backend, TT-Forge FE is an integral component of the TT-Forge project, which provides a comprehensive suite of tools for optimizing and deploying deep learning models on Tenstorrent hardware.

The main project goals are:

  • Provide abstraction of many different frontend frameworks (PyTorch, TensorFlow, ONNX, etc.)
  • Compile many kinds of model architectures without custom modification and with great performance (for example, Transformers, CNNs, etc.)
  • Abstract all Tenstorrent device architectures (for example, Wormhole, Blackhole, etc.)