VLM

Models of this kind. A tt-inference-server model's kind is its model type. A tt-model bundle's kind is the task tag on its card.

2 models Filter

Qwen3-VL-32B-Instruct

Qwen/Qwen3-VL-32B-Instruct

Listed in tt-inference-server on 1 hardware type; best status Functional.

Runs on: WH LoudBox/QuietBox
Speed: ≥ 3.8 tok/s≤ 1.5 s WH LoudBox/QuietBox
Status: Functional
tt launch: 2 clients

gemma-3-27b-it

google/gemma-3-27b-it

Listed in tt-inference-server on 1 hardware type; best status Experimental.

Runs on: WH Galaxy
Speed: ≥ 4.3 tok/s≤ 760 ms WH Galaxy
Status: Experimental
tt launch: 2 clients