Models

FLUX.1-dev

Listed in tt-inference-server on 6 hardware types; best status Complete.

In tt-inference-server

HardwareEngine and implementationStatusContextUsersBuildSupport page
BH 4xP150
P150X4
media
tt-transformers
Complete 64K 1
tt-metal 555f240
Image ghcr.io/tenstorrent/tt-media-inference-server:0.10.0-555f240
Open
BH LoudBox
P150X8
media
tt-transformers
Complete 64K 1
tt-metal 555f240
Image ghcr.io/tenstorrent/tt-media-inference-server:0.10.0-555f240
Open
BH P300
P300
media
tt-transformers
Complete 64K 1
tt-metal 555f240
Image ghcr.io/tenstorrent/tt-media-inference-server:0.10.0-555f240
Open
BH QuietBox 2
P300X2
media
tt-transformers
Complete 64K 1
tt-metal 8c48a10
Image ghcr.io/tenstorrent/tt-media-inference-server:0.17.0-8c48a10
Open
WH Galaxy
GALAXY
media
tt-transformers
Complete 64K 1
tt-metal 555f240
Image ghcr.io/tenstorrent/tt-media-inference-server:0.10.0-555f240
Open
WH LoudBox/QuietBox
T3K
media
tt-transformers
Complete 64K 1
tt-metal 555f240
Image ghcr.io/tenstorrent/tt-media-inference-server:0.10.0-555f240
Open

Status, context and users are copied from tt-inference-server's release spec (commit 2db98e38c, release 0.25.0). Context is the longest prompt plus reply the entry allows. Users is its highest concurrency. Each row carries its own code link, tt-metal and vLLM commits and image, because they differ between hardware. Nothing on this page is measured.

tt-model bundles

No tt-model bundle has been published for this model.

Details

KindImage generation (from tt-inference-server model type)
FamilyFLUX (from the start of the name)
Implementationtt-transformers
Disk needed15 GB
RAM needed6 GB
Listed bytt-inference-server