Topics

Data Engineering, Analytics & Machine Learning

Explore in the directory →

What this field covers

Data pipelines, analytics, and machine learning engineering.

Projects & technology

  • Baidu

    Technology company associated with PaddlePaddle and Apollo.

  • Huawei

    Technology company associated with MindSpore and the origin of openGauss.

  • Alibaba Canal

    Canal is Alibaba's change-data-capture component for subscribing to MySQL binary logs and distributing database changes to downstream consumers.

  • Alibaba DataX

    DataX is an Alibaba-published framework for synchronizing data between heterogeneous sources and destinations, with connectors and batch transfer tooling.

  • Angel

    Angel is a distributed machine-learning framework and parameter-server platform with graph and large-scale model-training capabilities.

  • Apache DolphinScheduler

    Apache DolphinScheduler is a distributed workflow scheduler for data pipelines, supporting visual DAG-based orchestration and task scheduling.

  • Apache InLong

    Apache InLong is a data integration framework for collecting and transferring large volumes of data between heterogeneous systems.

  • Apache Kylin

    Apache Kylin is an OLAP analytics engine that originated with an eBay engineering team including Chinese developers.

  • Apache Linkis

    Apache Linkis is a distributed middleware layer connecting and governing big-data computation engines and application services.

  • Apache SeaTunnel

    Apache SeaTunnel is a distributed data integration framework for high-volume ingestion, synchronization and transformation.

  • Apache StreamPark

    Apache StreamPark is a framework and operations platform for developing and managing Flink and Spark streaming applications.

  • FATE

    FATE is a federated-learning framework that enables collaborative machine learning across organizations without centralizing all raw training data.

  • MindSpore

    AI framework for model development, training, and deployment.

  • OpenMLDB

    OpenMLDB is a machine-learning database from Fourth Paradigm, designed for online and offline feature computation for production ML systems.

  • PaddlePaddle

    Open-source deep-learning framework for model development and deployment.

Related technologies

Related topics

Related Radar coverage