Models

stable-diffusion-xl-base-1.0-img-2-img

Listed in tt-inference-server on 4 hardware types; best status Complete.

In tt-inference-server

HardwareEngine and implementationStatusContextUsersBuildSupport page
WH Galaxy
GALAXY
media
tt-transformers
Complete 64K 16
tt-metal bac8b34
Image ghcr.io/tenstorrent/tt-media-inference-server:0.11.1-bac8b34
-
WH LoudBox/QuietBox
T3K
media
tt-transformers
Complete 64K 4
tt-metal bac8b34
Image ghcr.io/tenstorrent/tt-media-inference-server:0.11.1-bac8b34
-
n150
N150
media
tt-transformers
Complete 64K 1
tt-metal bac8b34
Image ghcr.io/tenstorrent/tt-media-inference-server:0.11.1-bac8b34
-
n300
N300
media
tt-transformers
Complete 64K 1
tt-metal bac8b34
Image ghcr.io/tenstorrent/tt-media-inference-server:0.11.1-bac8b34
-

Status, context and users are copied from tt-inference-server's release spec (commit 2db98e38c, release 0.25.0). Context is the longest prompt plus reply the entry allows. Users is its highest concurrency. Each row carries its own code link, tt-metal and vLLM commits and image, because they differ between hardware. Nothing on this page is measured.

tt-model bundles

No tt-model bundle has been published for this model.

Details

KindImage generation (from tt-inference-server model type)
FamilyStable Diffusion (from the start of the name)
Implementationtt-transformers
Disk needed15 GB
RAM needed6 GB
Listed bytt-inference-server