Skip to content

vllm.transformers_utils.configs

Model configs may be defined in this directory for the following reasons:

  • There is no configuration file defined by HF Hub or Transformers library.
  • There is a need to override the existing config to support vLLM.
  • The HF model_type isn't recognized by the Transformers library but can be mapped to an existing Transformers config, such as deepseek-ai/DeepSeek-V3.2-Exp.

Modules:

Name Description
AXK1
arctic

Arctic model configuration

bagel
colmodernvbert

Configuration for ColModernVBERT visual document retrieval model.

colpali

ColPali configuration that extends PaliGemmaConfig with embedding projection

colqwen3

ColQwen3 configuration that extends Qwen3VLConfig with embedding projection

extract_hidden_states

Config definitions for ExtractHiddenStatesModel, to be used with

falcon

Falcon configuration

hunyuan_vl
isaac
jais

JAIS configuration

kimi_k25

Kimi-K2.5 Model Configuration.

lfm2_moe
mlp_speculator
nemotron

Nemotron model configuration

nemotron_h

NemotronH model configuration

olmo_hybrid
ovis
qwen3_5

Qwen3.5 model configuration

qwen3_5_moe

Qwen3.5-MoE model configuration

qwen3_asr
qwen3_next

Qwen3-Next model configuration

radio

Radio vision model configuration

speculators
tarsier2
ultravox