Skip to content

MLECO-6647: MNN Integration into LLM

Yunus Kalkan requested to merge feature/mnn-integration into main
  • Add MNN backend support for both text and multimodal (vision + text) inference
  • Introduce new LlmChat class to manage chat templates, payloads, and framework-specific ApplyAutoChatTemplate behavior.
  • Modified configuration.json to adopt a structured format with nested sections for 'model', 'runtime', 'chat', 'stopWords'.
  • Updated LlmConfig to align with the new structured configuration format.

Change-Id: Idd5940c473418402388873e1a4347f835212f706 Signed-off-by: Yunus Kalkan yunus.kalkan@arm.com

Merge request reports