Skip to content

vllm.models.mistral.nvidia

Modules:

  • attention –
  • indexer –

    DSA lightning indexer and its FP8 key cache.

  • moe –
  • ops –

    Hand-fused eager kernels for Mistral models.

  • ssmax –

    Scalable-softmax (SSMax) query scaling.