ttnn.rms_norm

ttnn.rms_norm(input_tensor: ttnn.Tensor, *, memory_config: ttnn.MemoryConfig | None = None, epsilon: float, weight: ttnn.Tensor | None = None, bias: ttnn.Tensor | None = None, residual_input_tensor: ttnn.Tensor | None = None, program_config: ttnn.ProgramConfig | None = None, compute_kernel_config: ttnn.DeviceComputeKernelConfig = None) → ttnn.Tensor

Compute rms_norm over input_tensor.

Parameters:

input_tensor (ttnn.Tensor) – the input tensor.

Keyword Arguments:

• memory_config (ttnn.MemoryConfig, optional) – Memory configuration for the operation. Defaults to None.

• epsilon (float) – 1e-12.

• weight (ttnn.Tensor, optional) – Defaults to None.

• bias (ttnn.Tensor, optional) – Defaults to None.

• residual_input_tensor (ttnn.Tensor, optional) – Defaults to None.

• program_config (ttnn.ProgramConfig, optional) – Defaults to None.

• compute_kernel_config (ttnn.DeviceComputeKernelConfig) – Defaults to None.

Returns:

ttnn.Tensor – the output tensor.