Technology Directory

Project / repository / AI Engineering, Agents & Infrastructure

LMDeploy

LMDeploy is a toolkit for compressing, deploying and serving large language models, associated with the InternLM and Shanghai AI Laboratory ecosystem.

• Open Source
• Python

Project / repository / Databases, Search & Data Systems

Milvus

Open-source vector database for AI applications and vector search.

• Open Source

Project / repository / Data Engineering, Analytics & Machine Learning

MindSpore

AI framework for model development, training, and deployment.

Built by: Huawei

• Open Source

Project / repository / AI Engineering, Agents & Infrastructure

MNN

Lightweight on-device machine learning inference framework from Alibaba Group.

Built by: Alibaba Group

• Open Source

Project / repository / AI Engineering, Agents & Infrastructure

ModelScope

Model-as-a-Service library and platform for discovering, training, evaluating, and deploying AI models.

Built by: Alibaba Cloud

Connected technology: Dragonfly

• Open Source

Project / repository / AI Engineering, Agents & Infrastructure

OpenCompass

OpenCompass is a model evaluation framework for language and multimodal AI, organizing benchmarks, datasets and repeatable evaluation runs.

• Open Source
• Python

Project / repository / Data Engineering, Analytics & Machine Learning

PaddlePaddle

Open-source deep-learning framework for model development and deployment.

Built by: Baidu

• Open Source

Project / repository / AI Engineering, Agents & Infrastructure

RAGFlow

RAGFlow is a retrieval-augmented generation platform combining document ingestion, knowledge retrieval and agentic workflows.

• Open Source

Project / repository / AI Engineering, Agents & Infrastructure

Xinference

Xinference is a model-serving toolkit with APIs for deploying language, audio, embedding and multimodal models across local and clustered infrastructure.

• Open Source