mlc-ai

mlc-llm

未分类

mlc-ai

Universal LLM Deployment Engine with ML Compilation

20.5k
Stars
1.7k
Forks
250
Issues
142
Contributors
181
Watchers
llmmachine-learning-compilationlanguage-modeltvm
Python
{"name":"Apache License 2.0","spdxId":"Apache-2.0"}

Project Description

MLC LLM is a universal solution that enables the local deployment of any language model across various hardware backends and native applications, allowing everyone to develop, optimize, and deploy AI models locally on their own devices.

© 2025 GitHub Fun. All rights reserved.