vllm.tokenizers.mistral
¶
Functions:
-
tekken_convert_ids_to_tokens–Convert ids to pieces, using raw
bytesfor byte-fallback tokens. -
tekken_convert_tokens_to_string–Reassemble pieces from
tekken_convert_ids_to_tokensinto text. -
to_mistral_response_format–Convert an OpenAI response format to its mistral-common equivalent.
-
truncate_tool_call_ids–Truncates tool call IDs for Mistral's ID requirements.
tekken_convert_ids_to_tokens(tokenizer, ids)
¶
Convert ids to pieces, using raw bytes for byte-fallback tokens.
Source code in vllm/tokenizers/mistral.py
tekken_convert_tokens_to_string(tokenizer, tokens)
¶
Reassemble pieces from tekken_convert_ids_to_tokens into text.
Source code in vllm/tokenizers/mistral.py
to_mistral_response_format(response_format)
¶
Convert an OpenAI response format to its mistral-common equivalent.
Returns:
-
ResponseFormat | None–The converted format, or
Nonefor formats that do not affect Mistral -
ResponseFormat | None–prompt rendering (
text, structural tags, schema-lessjson_schema).
Source code in vllm/tokenizers/mistral.py
truncate_tool_call_ids(request)
¶
Truncates tool call IDs for Mistral's ID requirements.