vllm.models.mistral.mistral_large4.amd.specialized_decode
¶
Modules:
Classes:
Functions:
-
specialized_decode_config–The deployment's specialized decode, None for vLLM's decode. Raises with
DecodeConfig
dataclass
¶
Methods:
-
refusal_reasons–Default-deny: every deployment feature the kernels do not serve.
Source code in vllm/models/mistral/mistral_large4/amd/specialized_decode/runtime/spec.py
refusal_reasons(config)
¶
Default-deny: every deployment feature the kernels do not serve.
Source code in vllm/models/mistral/mistral_large4/amd/specialized_decode/runtime/spec.py
specialized_decode_config(config)
¶
The deployment's specialized decode, None for vLLM's decode. Raises with every reason when it is requested for an unsupported deployment.