LiteLLMPublished 10 Apr 2024NVD status: Analyzed

CVE-2024-2952

BerriAI/litellm is vulnerable to Server-Side Template Injection (SSTI) via the /completions endpoint.

ComponentLiteLLM
Severitycritical (CVSS 9.8)
CVSS vectorCVSS:3.0/AV:N/AC:L/PR:N/UI:N/S:U/C:H/I:H/A:H
Published (NVD)2024-04-10
Last modified2026-06-17
Affected versions
< 1.34.42
Fixed in1.34.42
WeaknessCWE-76
CISA KEVnot listed

NVD description

BerriAI/litellm is vulnerable to Server-Side Template Injection (SSTI) via the /completions endpoint. The vulnerability arises from the hf_chat_template method processing the chat_template parameter from the tokenizer_config.json file through the Jinja template engine without proper sanitization. Attackers can exploit this by crafting malicious tokenizer_config.json files that execute arbitrary code on the server.

What to do

  • Upgrade LiteLLM to 1.34.42 or later.
  • Do not expose the component's API or UI to the internet without authentication in front of it.

Sources

Read more