mlc-ai

mlc-llm

未分类

mlc-ai

Universal LLM Deployment Engine with ML Compilation

21.2k
Stars
1.8k
Forks
297
Issues
144
Contributors
188
Watchers
llmmachine-learning-compilationlanguage-modeltvm
Python
{"name":"Apache License 2.0","spdxId":"Apache-2.0"}

Project Description

MLC LLM is a universal solution that enables the local deployment of any language model across various hardware backends and native applications, allowing everyone to develop, optimize, and deploy AI models locally on their own devices.

© 2025 GitHub Fun. All rights reserved.