ttnn.deallocate

ttnn.deallocate = Operation(python_fully_qualified_name='ttnn.deallocate', function=<function PyCapsule.deallocate>, preprocess_golden_function_inputs=<function default_preprocess_golden_function_inputs>, golden_function=None, postprocess_golden_function_outputs=<function default_postprocess_golden_function_outputs>, is_cpp_operation=False, is_experimental=False)

Releases the resources for ttnn.Tensor tensor explicitly.

Parameters:

  • tensor (ttnn.Tensor) – The tensor whose resources will be released.

  • force (bool, optional) – Whether to force deallocation, even if the buffer may have multiple references. Defaults to True.

Example

>>> device_id = 0
>>> device = ttnn.open_device(device_id=device_id)
>>> tensor = ttnn.to_device(ttnn.from_torch(torch.randn((10, 64, 32), dtype=torch.bfloat16)), device)
>>> tensor = ttnn.to_layout(tensor, layout=ttnn.TILE_LAYOUT)
>>> ttnn.deallocate(tensor)