ttmetal.create_buffer (tt::ttmetal::CreateBufferOp)
Create buffer op.
Create buffer operation
Interfaces: MemoryEffectOpInterface (MemoryEffectOpInterface)
Effects: MemoryEffects::Effect{MemoryEffects::Allocate on ::mlir::SideEffects::DefaultResource}
Attributes:
| Attribute | MLIR Type | Description |
|---|---|---|
address | ::mlir::IntegerAttr | 64-bit signless integer attribute |
Results:
| Result | Description |
|---|---|
result | non-0-ranked.memref of any type values |
ttmetal.deallocate_buffer (tt::ttmetal::DeallocateBufferOp)
Deallocate buffer op.
Deallocate buffer operation
Interfaces: MemoryEffectOpInterface (MemoryEffectOpInterface)
Effects: MemoryEffects::Effect{MemoryEffects::Free on ::mlir::SideEffects::DefaultResource}
Operands:
| Operand | Description |
|---|---|
input | non-0-ranked.memref of any type values |
ttmetal.enqueue_program (tt::ttmetal::EnqueueProgramOp)
Enqueue program op.
Enqueue program operation
Traits: AttrSizedOperandSegments
Interfaces: MemoryEffectOpInterface (MemoryEffectOpInterface)
Effects: MemoryEffects::Effect{MemoryEffects::Read on ::mlir::SideEffects::DefaultResource, MemoryEffects::Write on ::mlir::SideEffects::DefaultResource}
Attributes:
| Attribute | MLIR Type | Description |
|---|---|---|
cb_ports | ::mlir::DenseI64ArrayAttr | i64 dense array attribute |
kernelConfigs | ::mlir::ArrayAttr |
Operands:
| Operand | Description |
|---|---|
buffers | variadic of non-0-ranked.memref of any type values |
cbs | variadic of non-0-ranked.memref of any type values |
ttmetal.enqueue_read_buffer (tt::ttmetal::EnqueueReadBufferOp)
Enqueue read buffer op.
Enqueue read buffer operation
Interfaces: MemoryEffectOpInterface (MemoryEffectOpInterface)
Effects: MemoryEffects::Effect{MemoryEffects::Read on ::mlir::SideEffects::DefaultResource, MemoryEffects::Write on ::mlir::SideEffects::DefaultResource}
Operands:
| Operand | Description |
|---|---|
input | non-0-ranked.memref of any type values |
output | non-0-ranked.memref of any type values |
ttmetal.enqueue_write_buffer (tt::ttmetal::EnqueueWriteBufferOp)
Enqueue write buffer op.
Enqueue write buffer operation
Interfaces: MemoryEffectOpInterface (MemoryEffectOpInterface)
Effects: MemoryEffects::Effect{MemoryEffects::Read on ::mlir::SideEffects::DefaultResource, MemoryEffects::Write on ::mlir::SideEffects::DefaultResource}
Operands:
| Operand | Description |
|---|---|
input | non-0-ranked.memref of any type values |
output | non-0-ranked.memref of any type values |
ttmetal.finish (tt::ttmetal::FinishOp)
Finish op for command queue.
Global barrier op, used to wait for all commands on queue to finish.
Interfaces: MemoryEffectOpInterface (MemoryEffectOpInterface)
Effects: MemoryEffects::Effect{MemoryEffects::Read on ::mlir::SideEffects::DefaultResource, MemoryEffects::Write on ::mlir::SideEffects::DefaultResource}
ttmetal.mesh_shard (tt::ttmetal::MeshShardOp)
Nd sharding or (partial) concat op
Nd sharding or (partial) concat op in D2M runtime. ShardToFull: Nd sharding in host memory. FullToshard: (partial) concat in host memory.
Interfaces: MemoryEffectOpInterface (MemoryEffectOpInterface)
Effects: MemoryEffects::Effect{MemoryEffects::Read on ::mlir::SideEffects::DefaultResource, MemoryEffects::Allocate on ::mlir::SideEffects::DefaultResource}
Attributes:
| Attribute | MLIR Type | Description |
|---|---|---|
shard_type | ::mlir::tt::ttcore::MeshShardTypeAttr | MeshShard shard_type attribute in TT dialect{{% markdown %}} Define sharded tensor data of mesh_shard op. - Identity: input and output tensors are pre-sharded (same data) and no sharding is required. - Replicate: all of the devices has full tensor (same data). - Maximal: one or part of the devcices has full tensor (same data). - Devices: all or part of the devices has sharded (partial) tensor (different data). {{% /markdown %}} |
shard_direction | ::mlir::tt::ttcore::MeshShardDirectionAttr | TT MeshShardDirection |
shard_shape | ::mlir::DenseI64ArrayAttr | i64 dense array attribute |
shard_dims | ::mlir::DenseI64ArrayAttr | i64 dense array attribute |
Operands:
| Operand | Description |
|---|---|
input | non-0-ranked.memref of any type values |
Results:
| Result | Description |
|---|---|
result | non-0-ranked.memref of any type values |