L2M2 ("LLM Manager" → "LLMM" → "L2M2") is a tiny and very simple LLM manager for Python that exposes lots of models through a unified API. If you plan to use an API-based model, at least one of the ...
Abstract: In recent years, artificial intelligence (AI) technologies represented by foundation models have experienced rapid development. Concurrently, on-device AI inference has become the primary ...