What is "llama.cpp"?

LLM inference in C/C++

How to use this package

Quick install

Installs the package into the current environment for this session. Use --build or --runtime to persist it as a build-time or runtime dependency.

min add llama.cpp

Declare as a task dependency in minimal.toml

Listing the package under tasks.<name>.packages makes it available inside that task’s sandbox.

[tasks.dev]
packages = ["llama.cpp"]

Build-time vs runtime

Choose build-time for tools needed during compilation, runtime for dynamic libraries loaded at runtime.

min add --build llama.cpp
min add --runtime llama.cpp

Compare versions

to

Dependencies (8)

Dependencies
Name	Version	Kind
base	—	build
cmake	4.4.2	build
curl	8.22.0	runtime
git	2.55.0	build
hwdata	0.410	runtime
make	4.4.1	build
pciutils	3.15.0	runtime
toolchain	—	build

Dependency changes

No dependants

No other packages in the registry depend on this one.

llama.cpp vb103576377f9c
Diff
Lines:+2 / -2Deps:8CVE:3
Released: 2 months ago
llama.cpp vb101413136792
Diff
Lines:+2 / -2Deps:8
Released: 3 months ago
llama.cpp vb10093da8395b
Diff
Lines:+2 / -2Deps:8
Released: 3 months ago
llama.cpp vb89414c0e56c
Diff
Lines:+3 / -2Deps:8
Released: 6 months ago
llama.cpp vb8651b0d87dd
Diff
Lines:+2 / -2Deps:8
Released: 6 months ago
llama.cpp vb804111a4145
Diff
Lines:+20 / -7Deps:8(-1)
Released: 6 months ago
1. 11a4145
  Diff
  Lines:+2 / -2Deps:8
  Released: 6 months ago
2. 7e5bdad
  Diff
  Lines:+1Deps:8
  Released: 6 months ago
3. e3e0bf9
  Diff
  Lines:+3 / -1Deps:8
  Released: 7 months ago
4. e4a695e
  Diff
  Lines:+1 / -1Deps:8(-1)
  Released: 8 months ago
5. 859ee45
  Diff
  Lines:+5Deps:9
  Released: 8 months ago
6. 1d39a4b
  Diff
  Lines:+6 / -1Deps:9
  Released: 8 months ago
7. 6da0f6c
  Diff
  Lines:+2 / -2Deps:9
  Released: 8 months ago
llama.cpp vb80382577b7a
Diff
Lines:+2 / -2Deps:9
Released: 8 months ago
llama.cpp vb7999e4f1196
Diff
Lines:+2 / -2Deps:9
Released: 8 months ago
llama.cpp vb79745313533
Diff
Lines:+3 / -3Deps:9
Released: 8 months ago
1. 5313533
  Diff
  Lines:+1 / -1Deps:9
  Released: 8 months ago
2. 6b9423e
  Diff
  Lines:+2 / -2Deps:9
  Released: 8 months ago
llama.cpp vb79569d36aa3
Diff
Lines:+2 / -2Deps:9
Released: 8 months ago
llama.cpp vb79517b18160
Diff
Lines:+2 / -2Deps:9
Released: 8 months ago
llama.cpp vb793667f247f
Diff
Lines:+2 / -2Deps:9
Released: 8 months ago
llama.cpp vb7922300e264
Diff
Lines:+2 / -2Deps:9
Released: 8 months ago
llama.cpp vb7909dd4448a
Diff
Lines:+2 / -2Deps:9
Released: 8 months ago
llama.cpp vb7843fb9fd9a
Diff
Lines:+2 / -2Deps:9
Released: 9 months ago
llama.cpp vb7818118f4cb
Diff
Lines:+2 / -2Deps:9
Released: 9 months ago
llama.cpp vb7809dc3dda7
Diff
Lines:+2 / -2Deps:9
Released: 9 months ago
llama.cpp vb7783b9ebcd4
Diff
Lines:+15 / -8Deps:9(+1)
Released: 9 months ago
1. b9ebcd4
  Diff
  Lines:+3Deps:9
  Released: 9 months ago
2. 2eaacaf
  Diff
  Lines:+10 / -6Deps:9(+1)
  Released: 9 months ago
3. cd0f1dc
  Diff
  Lines:+2 / -2Deps:8
  Released: 9 months ago
llama.cpp vb77578bf4b98
Diff
Lines:+3 / -3Deps:8
Released: 9 months ago
llama.cpp vb7499240d505
Diff
Lines:+12 / -7Deps:8
Released: 10 months ago
llama.cpp vc3ca6ee
Diff
Lines:+48Deps:8(+8)
Released: 12 months ago

Showing 13 advisories

Security advisories for this package
	Status	IDs	Package	Version	Severity	Published
Critical (6)
	Affected: b10357	CVE-2026-107183	llama.cpp	b8651 – b10357	Critical	5 days ago
Summary llama.cpp before b11393 Use-After-Free via common_chat_peg_mapper chat_parser Affected ranges b8651 – b10357 References Advisory: https://github.com/CVEProject/cvelistV5/tree/main/cves/2026/107xxx/CVE-2026-107183.json, https://nvd.nist.gov/vuln/detail/CVE-2026-107183, https://www.vulncheck.com/advisories/llama-cpp-before-b11393-use-after-free-via-common-chat-peg-mapper-chat-parser Fix: https://github.com/ggml-org/llama.cpp/commit/dbe4c3ed42343f0a7ba0fd7e808ffeaca404d29f, https://github.com/ggml-org/llama.cpp/pull/29942 PACKAGE: https://github.com/ggml-org/llama.cpp ARTICLE: https://github.com/ggml-org/llama.cpp/blob/bed0a856606ee4a24a164066f73d2379447033f5/common/chat-peg-parser.cpp#L343-L355, https://github.com/ggml-org/llama.cpp/blob/bed0a856606ee4a24a164066f73d2379447033f5/tools/server/server-schema.cpp#L321-L324
	Resolved in b8651	CVE-2026-39909	llama.cpp	b7499 – b8041, fixed in b8651	Critical	2 months ago
Summary llama.cpp Use-After-Free in RPC GRAPH_RECOMPUTE Handler Affected ranges b7499 – b8041, fixed in b8651 Fixed in b8651 References Advisory: https://github.com/CVEProject/cvelistV5/tree/main/cves/2026/39xxx/CVE-2026-39909.json, https://github.com/ggml-org/llama.cpp/releases/tag/b8585, https://nvd.nist.gov/vuln/detail/CVE-2026-39909, https://www.vulncheck.com/advisories/llama-cpp-use-after-free-in-rpc-graph-recompute-handler Fix: https://github.com/ggml-org/llama.cpp/commit/389c7d4955ba55c7418afaebf7c23d9ed64ef707 Report: https://github.com/ggml-org/llama.cpp/pull/21175 PACKAGE: https://github.com/ggml-org/llama.cpp
	Resolved in b10093	CVE-2026-43632	llama.cpp	b7499 – b8941, fixed in b10093	Critical	2 months ago
Summary llama.cpp b7492–b9060 Use-After-Free in Tokenization Endpoints Affected ranges b7499 – b8941, fixed in b10093 Fixed in b10093 References Advisory: https://github.com/CVEProject/cvelistV5/tree/main/cves/2026/43xxx/CVE-2026-43632.json, https://nvd.nist.gov/vuln/detail/CVE-2026-43632, https://www.vulncheck.com/advisories/llama-cpp-b7492-b9060-use-after-free-in-tokenization-endpoints PACKAGE: https://github.com/Vladimir-tokarev-cyera/llama-cpp-security-patches
	Resolved in b10093	CVE-2026-43631	llama.cpp	b7499 – b8941, fixed in b10093	Critical	2 months ago
Summary llama.cpp b7492–b9060 Use-After-Free RCE via llama-server Affected ranges b7499 – b8941, fixed in b10093 Fixed in b10093 References Advisory: https://github.com/CVEProject/cvelistV5/tree/main/cves/2026/43xxx/CVE-2026-43631.json, https://nvd.nist.gov/vuln/detail/CVE-2026-43631, https://www.vulncheck.com/advisories/llama-cpp-b7492-b9060-use-after-free-rce-via-llama-server PACKAGE: https://github.com/Vladimir-tokarev-cyera/llama-cpp-security-patches
	Resolved in b10093	CVE-2026-43629	llama.cpp	b7499 – b8941, fixed in b10093	Critical	2 months ago
Summary llama.cpp b4882–b9058 Buffer Overflow in KV Cache State Restore Affected ranges b7499 – b8941, fixed in b10093 Fixed in b10093 References Advisory: https://github.com/CVEProject/cvelistV5/tree/main/cves/2026/43xxx/CVE-2026-43629.json, https://nvd.nist.gov/vuln/detail/CVE-2026-43629, https://www.vulncheck.com/advisories/llama-cpp-b4882-b9058-buffer-overflow-in-kv-cache-state-restore PACKAGE: https://github.com/Vladimir-tokarev-cyera/llama-cpp-security-patches
	Resolved in b8651	GHSA-j8rj-fmpv-wcxw CVE-2026-34159	llama.cpp	b7499 – b8041, fixed in b8651	Critical: 9.8	6 months ago
Summary llama.cpp: Unauthenticated RCE via GRAPH_COMPUTE buffer=0 bypass in llama.cpp RPC backend Affected ranges b7499 – b8041, fixed in b8651 Fixed in b8651 CVSS vector CVSS:3.1/AV:N/AC:L/PR:N/UI:N/S:U/C:H/I:H/A:H References Advisory: https://github.com/CVEProject/cvelistV5/tree/main/cves/2026/34xxx/CVE-2026-34159.json, https://github.com/ggml-org/llama.cpp/security/advisories/GHSA-j8rj-fmpv-wcxw, https://nvd.nist.gov/vuln/detail/CVE-2026-34159 Fix: https://github.com/ggml-org/llama.cpp/commit/39bf0d3c6a95803e0f41aaba069ffbee26721042, https://github.com/ggml-org/llama.cpp/pull/20908
High (5)
	Status	IDs	Package	Version	Severity	Published
	Resolved in b10093	CVE-2026-43628	llama.cpp	b7499 – b8941, fixed in b10093	High	2 months ago
Summary llama.cpp b3978–b9058 Integer Underflow via DRY Sampler Affected ranges b7499 – b8941, fixed in b10093 Fixed in b10093 References Advisory: https://github.com/CVEProject/cvelistV5/tree/main/cves/2026/43xxx/CVE-2026-43628.json, https://nvd.nist.gov/vuln/detail/CVE-2026-43628, https://www.vulncheck.com/advisories/llama-cpp-b3978-b9058-integer-underflow-via-dry-sampler PACKAGE: https://github.com/Vladimir-tokarev-cyera/llama-cpp-security-patches
	Resolved in b10093	CVE-2026-43627	llama.cpp	b7499 – b8941, fixed in b10093	High	2 months ago
Summary llama.cpp b1283–b9058 Integer Overflow in llama_batch_init() Function Affected ranges b7499 – b8941, fixed in b10093 Fixed in b10093 References Advisory: https://github.com/CVEProject/cvelistV5/tree/main/cves/2026/43xxx/CVE-2026-43627.json, https://nvd.nist.gov/vuln/detail/CVE-2026-43627, https://www.vulncheck.com/advisories/llama-cpp-b1283-b9058-integer-overflow-in-llama-batch-init-function PACKAGE: https://github.com/Vladimir-tokarev-cyera/llama-cpp-security-patches
	Resolved in b7843	GHSA-96jg-mvhq-q7q7 CVE-2026-33298	llama.cpp	b7499 – b7818, fixed in b7843	High: 7.8	7 months ago
Summary llama.cpp has a Heap Buffer Overflow via Integer Overflow in GGUF Tensor Parsing Affected ranges b7499 – b7818, fixed in b7843 Fixed in b7843 CVSS vector CVSS:3.1/AV:L/AC:L/PR:N/UI:R/S:U/C:H/I:H/A:H References Advisory: https://github.com/CVEProject/cvelistV5/tree/main/cves/2026/33xxx/CVE-2026-33298.json, https://github.com/ggml-org/llama.cpp/security/advisories/GHSA-96jg-mvhq-q7q7, https://nvd.nist.gov/vuln/detail/CVE-2026-33298 Web: https://github.com/ggml-org/llama.cpp/releases/tag/b7824
	Resolved in b8651	GHSA-3p4r-fq3f-q74v CVE-2026-27940	llama.cpp	b7499 – b8041, fixed in b8651	High: 7.8	7 months ago
Summary llama.cpp has a Heap Buffer Overflow via Integer Overflow in `mem_size` Calculation — Bypass of CVE-2025-53630 Fix Affected ranges b7499 – b8041, fixed in b8651 Fixed in b8651 CVSS vector CVSS:3.1/AV:L/AC:L/PR:N/UI:R/S:U/C:H/I:H/A:H References Advisory: https://github.com/CVEProject/cvelistV5/tree/main/cves/2026/27xxx/CVE-2026-27940.json, https://github.com/ggml-org/llama.cpp/security/advisories/GHSA-3p4r-fq3f-q74v, https://nvd.nist.gov/vuln/detail/CVE-2026-27940
	Under investigation	CVE-2026-21869	llama.cpp	0.6.0	High: 8.8	9 months ago
Summary llama.cpp is an inference of several LLM models in C/C++. In commits 55d4206c8 and prior, the n_discard parameter is parsed directly from JSON input in the llama.cpp server's completion endpoints without validation to ensure it's non-negative. When a negative value is supplied and the context fills up, llama_memory_seq_rm/add receives a reversed range and negative offset, causing out-of-bounds memory writes in the token evaluation loop. This deterministic memory corruption can crash the process or enable remote code execution (RCE). There is no fix at the time of publication. Affected ranges 0.6.0 CVSS vector CVSS:3.1/AV:N/AC:L/PR:N/UI:R/S:U/C:H/I:H/A:H
Medium (2)
	Status	IDs	Package	Version	Severity	Published
	Resolved in b7757	CVE-2026-43630	llama.cpp	b7499, fixed in b7757	Medium	2 months ago
Summary llama.cpp b5702–b7653 Out-of-Bounds Read Information Disclosure Affected ranges b7499, fixed in b7757 Fixed in b7757 References Advisory: https://github.com/CVEProject/cvelistV5/tree/main/cves/2026/43xxx/CVE-2026-43630.json, https://nvd.nist.gov/vuln/detail/CVE-2026-43630, https://www.vulncheck.com/advisories/llama-cpp-b5702-b7653-out-of-bounds-read-information-disclosure Fix: https://github.com/ggml-org/llama.cpp/commit/f93c09e2673090b59802f2552848a1cac70598b0 PACKAGE: https://github.com/Vladimir-tokarev-cyera/llama-cpp-security-patches, https://github.com/ggml-org/llama.cpp
	Under investigation	GHSA-g4cc-763q-h9h6	llama.cpp	0.6.0	Medium: 6.6	last year
Summary Heap-based Buffer Over-read in llama_model_load Affected ranges 0.6.0 CVSS vector CVSS:3.1/AV:L/AC:L/PR:L/UI:N/S:U/C:L/I:L/A:H References Web: https://github.com/ggml-org/llama.cpp/security/advisories/GHSA-g4cc-763q-h9h6
Low (0)
	Status	IDs	Package	Version	Severity	Published
Unknown (0)
	Status	IDs	Package	Version	Severity	Published

Build provenance

For the signed record of what the build used, see the Provenance tab.

67 components

Software Bill of Materials — every package this build depends on
Packages	Version	Repository	License
llama.cppROOT	b10357	github.com/ggml-org/llama.cpp	MIT
acl	2.4.0	https://storage.googleapis.com/minimal-staging-archives/acl-2.4.0.tar.xzMIRROR	(GPL-2.0-only AND LGPL-2.1-only)
attr	2.6.0	https://storage.googleapis.com/minimal-staging-archives/attr-2.6.0.tar.gzMIRROR	(GPL-2.0-only AND LGPL-2.1-only)
autoconf	2.73	www.gnu.org/software/autoconf	GPL-3.0-or-later WITH Autoconf-exception-3.0
automake	1.18.1	www.gnu.org/software/automake	GPL-2.0-only
bash	5.3	www.gnu.org/software/bash	GPL-3.0-only
bash-bootstrap	5.3	www.gnu.org/software/bash	GPL-3.0-only
binutils	2.47	www.gnu.org/software/binutils	(GPL-2.0-only AND GPL-3.0-only AND LGPL-2.0-only)
bison	3.8.2	www.gnu.org/software/bison	GPL-3.0-only
bzip2	1.0.8	github.com/libarchive/bzip2	bzip2-1.0.6
cmake	4.4.2	github.com/Kitware/CMake	BSD-3-Clause
coreutils	9.12	www.gnu.org/software/coreutils	GPL-3.0-only
curl	8.22.0	github.com/curl/curl	curl
diffutils	3.12	www.gnu.org/software/diffutils	GPL-3.0-only
expat	2.8.5	github.com/libexpat/libexpat	MIT
file	5.48	https://storage.googleapis.com/minimal-staging-archives/file-5.48.tar.gzMIRROR	BSD-2-Clause-Darwin
findutils	4.11.0	www.gnu.org/software/findutils	GPL-3.0-only
flex	2.6.4	github.com/westes/flex	BSD-3-Clause-flex
gawk	5.4.1	www.gnu.org/software/gawk	GPL-3.0-only
gawk-bootstrap	5.4.1	www.gnu.org/software/gawk	GPL-3.0-only
gcc	15.2.0	www.gnu.org/software/gcc	(GPL-2.0-only AND GPL-3.0-only AND LGPL-2.1-only)
gdbm	1.26	www.gnu.org/software/gdbm	GPL-3.0-only
gettext	1.0	www.gnu.org/software/gettext	GPL-3.0-only
git	2.55.0	github.com/git/git	GPL-2.0-only
glibc	2.44	www.gnu.org/software/glibc	(GPL-2.0-only AND LGPL-2.1-only)
gmp	6.3.0	www.gnu.org/software/gmp	LGPL-3.0-or-later OR GPL-2.0-or-later
grep	3.12	www.gnu.org/software/grep	GPL-3.0-only
gzip	1.15	www.gnu.org/software/gzip	GPL-3.0-only
hwdata	0.410	github.com/vcrhonek/hwdata	GPL-2.0-only
libcap	2.78	https://storage.googleapis.com/minimal-staging-archives/libcap-2.78.tar.xzMIRROR	BSD-3-Clause OR GPL-2.0-only
libffi	3.8.0	github.com/libffi/libffi	MIT
libidn2	2.3.8	www.gnu.org/software/libidn2	GPL-3.0-or-later AND (GPL-2.0-or-later OR LGPL-3.0-or-later)
libpsl	0.23.3	github.com/rockdaboot/libpsl	MIT
libssh2	1.11.1	github.com/libssh2/libssh2	BSD-3-Clause
libtool	2.6.2	www.gnu.org/software/libtool	GPL-2.0-only
libunistring	1.4.2	www.gnu.org/software/libunistring	GPL-3.0-only
libuv	1.52.1	github.com/libuv/libuv	MIT
linux_headers	6.12.43	github.com/torvalds/linux	GPL-2.0-only WITH Linux-syscall-note
llvm	21.1.8	github.com/llvm/llvm-project	Apache-2.0
llvm-bootstrap	21.1.8	github.com/llvm/llvm-project	Apache-2.0
lz4	1.10.0	github.com/lz4/lz4	BSD-2-Clause AND GPL-2.0-or-later
m4	1.4.21	www.gnu.org/software/m4	GPL-3.0-only
make	4.4.1	www.gnu.org/software/make	GPL-3.0-only
meson	1.12.0	github.com/mesonbuild/meson	Apache-2.0
mpc	1.4.1	www.gnu.org/software/mpc	LGPL-3.0-or-later
mpfr	4.2.2	www.gnu.org/software/mpfr	GPL-3.0-only
ncurses	6.6	www.gnu.org/software/ncurses	X11-distribute-modifications-variant
ninja	1.13.2	github.com/ninja-build/ninja	Apache-2.0
openssl	3.6.5	github.com/openssl/openssl	Apache-2.0
patch	2.8	www.gnu.org/software/patch	GPL-3.0-only
pciutils	3.15.0	github.com/pciutils/pciutils	GPL-2.0-or-later
pcre2	10.49	github.com/PCRE2Project/pcre2	BSD-3-Clause WITH PCRE2-exception
perl	5.44.0	github.com/Perl/perl5	Artistic-1.0-Perl OR GPL-1.0-or-later
pkgconf	3.0.5	github.com/pkgconf/pkgconf	ISC
python	3.14.8	github.com/python/cpython	Python-2.0.1
readline	8.3	www.gnu.org/software/readline	GPL-3.0-only
rust	1.99.0	github.com/rust-lang/rust	MIT OR Apache-2.0
rustc-1.98.1	1.98.1	github.com/rust-lang/rust	MIT OR Apache-2.0
sed	4.10	www.gnu.org/software/sed	GPL-3.0-only
setuptools	84.0.0	github.com/pypa/setuptools	MIT
sqlite	3.53.4	github.com/sqlite/sqlite	blessing
tar	1.35	www.gnu.org/software/tar	GPL-3.0-only
tzdata	2026e	github.com/eggert/tz	LicenseRef-Public-Domain
util-linux	2.42.4	github.com/util-linux/util-linux	GPL-2.0-or-later AND LGPL-2.1-or-later AND BSD-3-Clause
xz	5.8.4	github.com/tukaani-project/xz	(0BSD AND GPL-2.0-only AND GPL-3.0-only AND LGPL-2.1-only)
zlib	1.3.2	github.com/madler/zlib	Zlib
zstd	1.5.7	github.com/facebook/zstd	BSD-3-Clause OR GPL-2.0-only

llama.cpp

Install package

OpenSSF Score

What is "llama.cpp"?

How to use this package

Quick install

Declare as a task dependency in minimal.toml

Build-time vs runtime

Dependencies (8)

Dependency changes

Summary

Affected ranges

References

Summary

Affected ranges

Fixed in

References

Summary

Affected ranges

Fixed in

References

Summary

Affected ranges

Fixed in

References

Summary

Affected ranges

Fixed in

References

Summary

Affected ranges

Fixed in

CVSS vector

References

Summary

Affected ranges

Fixed in

References

Summary

Affected ranges

Fixed in

References

Summary

Affected ranges

Fixed in

CVSS vector

References

Summary

Affected ranges

Fixed in

CVSS vector

References

Summary

Affected ranges

CVSS vector

Summary

Affected ranges

Fixed in

References

Summary

Affected ranges

CVSS vector

References

Build provenance

Build provenance

Build provenance

67 components