Project
LMDeploy
LMDeploy is a toolkit for compressing, deploying and serving large language models, associated with the InternLM and Shanghai AI Laboratory ecosystem.
Origin & context
The official InternLM repository publishes LMDeploy as a model deployment toolkit from the Shanghai AI Laboratory research ecosystem.