bge-large-en-v1.5

Listed in tt-inference-server on 4 hardware types; best status Experimental.

In tt-inference-server

Hardware	Engine and implementation	Status	Context	Users	Build	Support page
WH Galaxy `GALAXY`	media tt-vllm-plugin	Experimental	64K	32	Code: https://github.com/tenstorrent/tt-inference-server/tree/dev/tt-vllm-plugin/tree/65718bb/tt_vllm_plugin tt-metal `65718bb` Image `ghcr.io/tenstorrent/tt-media-inference-server:0.2.0-2496be4518bca0a7a5b497a4cda3cfe7e2f59756`	Open
WH LoudBox/QuietBox `T3K`	media tt-vllm-plugin	Experimental	64K	4	Code: https://github.com/tenstorrent/tt-inference-server/tree/dev/tt-vllm-plugin/tree/65718bb/tt_vllm_plugin tt-metal `65718bb` Image `ghcr.io/tenstorrent/tt-media-inference-server:0.2.0-2496be4518bca0a7a5b497a4cda3cfe7e2f59756`	Open
n150 `N150`	media tt-vllm-plugin	Experimental	64K	1	Code: https://github.com/tenstorrent/tt-inference-server/tree/dev/tt-vllm-plugin/tree/65718bb/tt_vllm_plugin tt-metal `65718bb` Image `ghcr.io/tenstorrent/tt-media-inference-server:0.2.0-2496be4518bca0a7a5b497a4cda3cfe7e2f59756`	Open
n300 `N300`	media tt-vllm-plugin	Experimental	64K	1	Code: https://github.com/tenstorrent/tt-inference-server/tree/dev/tt-vllm-plugin/tree/65718bb/tt_vllm_plugin tt-metal `65718bb` Image `ghcr.io/tenstorrent/tt-media-inference-server:0.2.0-2496be4518bca0a7a5b497a4cda3cfe7e2f59756`	Open

Status, context and users are copied from tt-inference-server's release spec (commit 2db98e38c, release 0.25.0). Context is the longest prompt plus reply the entry allows. Users is its highest concurrency. Each row carries its own code link, tt-metal and vLLM commits and image, because they differ between hardware. Nothing on this page is measured.

tt-model bundles

No tt-model bundle has been published for this model.

Details

Kind	Embedding (from tt-inference-server model type)
Family	bge (from the start of the name)
Implementation	tt-vllm-plugin
Disk needed	15 GB
RAM needed	6 GB
Listed by	tt-inference-server