Skip to content

MLECO-6824: Add unified benchmarking tool and framework support

Yunus Kalkan requested to merge feature/arm-llm-benchmark into main
  • Add arm-llm-bench-cli standalone benchmark executable
  • Implement LlmBenchmark class with warm-up, iteration timing, and summary stats
  • Implement JNI bindings for benchmarking
  • Add framework-specific prompt generation (llama.cpp, ORT, MNN, MediaPipe)
  • The benchmark executable supports parameters for model path, input, output, number of threads, number of iterations and warm-up iterations
  • README update with usage instructions and build flag (-DBUILD_BENCHMARK=ON)

Change-Id: I1b6e8c7de3c43b3079d7806cf4eff4f138079665 Signed-off-by: Yunus Kalkan yunus.kalkan@arm.com

Merge request reports