Skip to content

MLECO-6636: Update to use latest llama.cpp dependency

Jerry Collins requested to merge feature/update-llama-cpp-october-2025 into main
  1. Supports latest llama.cpp (As of 13th Oct 2025).
  2. LLama.cpp backend now supports optimized arch. variant shared libraries (Android only). Optimised library is selected and loaded at runtime automatically.
  3. Support for Arm v9 variants have been added to llama.cpp (android only).
  4. Now using catch2 & config & share lib directory passed into test via CLI.
  5. Now builds test source code once, previously built test source code multiple times, for each test configuration.
  6. Added a circuit-breaker for cpp tests to prevent infinite loop on on getNextToken.
  7. Android builds default to BUILD_SHARED_LIBS=ON, and terminates build if users attempts to override.
  8. Disabled intermittently failing test. 10.Updated documentation.

Signed-off-by: jerry collins jerry.collins@arm.com Change-Id: I7a3bc97c33849fe6cf7f0e06a559db244715a2b5

Merge request reports