Apple ML Team Orchestrates Large-Scale Data Pipelines with Kestra

Apple's 200-engineer ML team replaced Airflow with Kestra to orchestrate large-scale ETL workloads with declarative syntax and robust fault tolerance.

Apple's 200-engineer ML team replaced Airflow with Kestra to orchestrate large-scale ETL workloads with declarative syntax and robust fault tolerance.
/_astro/logo.BdYnjE1O.svg

Industry

Technology

Headquarter

Cupertino, USA

Solution

Apple is a global technology leader whose services, including the App Store, Apple Music, and device ecosystems, generate some of the world's largest data volumes, processed daily by a 200-engineer ML team.

Stack

Kestra

Kestra

Commands

Upload

Query

Parallel

Share this story

I want to highlight their robustness, which is crucial at our scale. Few companies operate at this level, especially in AI/ML.

Senior Engineering Manager

Apple ML Team
See How

Experience Kestra Today

What would change if your ML data pipelines processed at massive scale, orchestrating complex ETL workloads between your data warehouse and ML platform with declarative simplicity?

Similar Kestra Stories

Amdocs Delivers Integration Environments as a Service with Kestra

Amdocs: Amdocs Delivers Integration Environments as a Service with Kestra


Copines De Voyage: Enhancing Travel Experiences Through Advanced Data Orchestration with Kestra

Copines De Voyage: Enhancing Travel Experiences Through Advanced Data Orchestration with Kestra


Ntico Manage Geospatial Data Operations with Kestra

Ntico Manage Geospatial Data Operations with Kestra