Dependencies

• TT-LIB
  • Overview
    • Operation Infrastructure
      • New Device Operation
      • New Device Operation with a member
      • New Device Operation with Optional Input Tensors
      • New Device Operation with Optional Output Tensors
    • Profiler
    • Fast Dispatch
      • cpu()
    • Program Caching
    • Logs
  • TT-LIB API through tt_lib
    • Primary Operations
      • softmax()
      • softmax_backward()
      • softmin()
      • softmin_backward()
      • logsoftmax()
      • logsoftmax_backward()
      • mean()
      • mean_backward()
      • group_norm()
      • group_norm_backward()
      • norm()
      • norm_backward()
    • Enums
      • BcastOpMath
      • BcastOpDim
  • Fallback Operations
    • full()
    • tensor_slice()
    • reshape()
    • chunk()
    • conv2d()
    • group_norm()
    • layer_norm()
    • pad()
    • interpolate()
    • repeat()
    • repeat_interleave()
    • concat()
    • silu()
    • softmax()
    • Conv2d
    • BatchNorm2d
    • GroupNorm
    • LayerNorm
    • MaxPool2d
    • AdaptiveAvgPool2d
    • ceil
    • floor
    • trunc
    • unary_fmod
    • binary_fmod
    • bitwise_not
    • unary_bitwise_or
    • unary_bitwise_and
    • unary_bitwise_xor
    • binary_bitwise_or
    • binary_bitwise_and
    • binary_bitwise_xor
    • unary_bitwise_left_shift
    • unary_bitwise_right_shift
    • binary_bitwise_left_shift
    • binary_bitwise_right_shift
    • torch_argmax
    • torch_argmin
  • Experimental Operations
    • Fused Operations from tt_lib Mini-Graph Library
      • Linear()
      • Layernorm()
      • AddAndNorm()
    • Complex Operations (Type 2)
• Tensor
  • Overview
  • Tensor Storage
  • Tensor API
    • Tensor
      • Tensor.__init__()
      • Tensor.buffer()
      • Tensor.device()
      • Tensor.get_dtype()
      • Tensor.get_layout()
      • Tensor.pad()
      • Tensor.pad_to_tile()
      • Tensor.storage_type()
      • Tensor.to()
      • Tensor.unpad()
      • Tensor.unpad_from_tile()
  • MemoryConfig
    • MemoryConfig
      • MemoryConfig.__init__()
  • Examples of converting between PyTorch Tensor and TT Tensor
    • Converting a PyTorch Tensor to a TT Tensor
    • Converting a TT Tensor to a PyTorch Tensor
• Examples of Tensor and TT-LIB Use
  • Run one OP from TT-LIB on TT Accelerator device
  • Run TT-LIB and PyTorch OPs
  • Tensors with odd size of last dim