Fast, Scalable, and Declarative Data Management

Create and Deploy all kinds of Data Pipelines with Ease and Speed with Kestra: Your All-in-One Solution for Orchestrating Workflows

Get started Live demo

A screenshot of the user interface of Kestra's application

The Ultimate Orchestrator for Reliable Data Workflows

Finally an orchestrator that get it right

A YAML sample of code for declarative language and construction of Kestra's flows

Declarative code for creating flows

Easy Workflow Creation: Build custom workflows quickly and with minimal coding using YAML.
Intuitive User Interface: Visualize and manipulate workflow directly from the UI.

Quick and Easy Workflow Building

Optimized Task Management: Seamless task execution in a variety of ways including sequential, parallel, and conditional execution.
Intuitive Orchestration: Easily manage task dependencies and ensure proper execution order.
Flexible Workflow Control: Full control of workflow orchestration, ensuring tasks are running efficiently.

Image of execution of a task on Kestra with event or time based triggering

A list of flowable tasks such as sequential, parallel, loop, switch, pause and template

Flexible Workflow Scheduling

Time-based scheduling: Workflows run automatically at specific times, such as daily, weekly, or monthly for a regular execution without the need for manual intervention.
Event-based scheduling: Trigger workflows to run automatically in response to events, such as the arrival of new data or the completion of other workflows. Automate workflow executions based on real-time events.

Execute and Monitor in Real Time

Real-time Workflow Monitoring: Progress tracking of workflows and individual tasks in real-time.
Actionable Insights: insights of workflows performances using built-in logs and metrics.
Intuitive User Interface: Quick Workflow execution and view of the state of tasks directly from the UI.

FEATURES

Save on time, stress, and development costs.

Deploy and Run Anywhere

From on-premise installations to cloud-based services, containers to clusters, Kestra can be deployed anywhere.

Seamless Integrations

Connect to various data sources and cloud services like AWS, GCP, and Microsoft Azure.

Scale to Millions Executions

Kestra has been built with leading cloud-native technologies and a strong architecture, enabling scaling to millions of executions without hassle.

Logos of tools that integrate with Kestra such as Snowflake, Airbyte, DBT or Fivetran and Kestra at the center of It

Limitless Integration

Customize and extend the capabilities and functionalities of Kestra with the plugins feature. integrate and connect all kind of data sources, cloud services, databases, transformation, quality, notification tools and even more! It is also possible to create Custom Plugins that add specific custom features to meet your specifics needs.

See all plugins Create your plugin

Seamless Workflow Design and Management

Create your Flows, Avoid the Headache

Simplicity

Easily create, configure, and modify flows with Kestra's YAML format and user interface.

Helpful

Error spotting directly in the editor before any runtime error.

Allow other programming languages

Run any scripting language like Python, Bash, and Node.js using Kestra.

Use workflows as code

Deploy workflows like software code for easier collaboration and tracking of changes.

File processing capabilities

Files processing including CSV and JSON.

Versioning

Version workflows, tasks and data, rollback and execute a previous version track changes over time.

Reusability

Define generic tasks and workflows that can be used in different contexts.

Data validation

Ensures incoming and outgoing data in the pipeline steps comply with schema and quality constraints.

UI testing

Execution testing directly in the interface for fast Q&A before deployment.

Debugging

Advanced debugging tools directly in the flow editing interface for faster identification and troubleshooting.

No more deployment complexity

No need to create a dev environment to package and deploy an application, just work on the browser and use CI/CD.

Accelerate Development and Deployment

Build Faster, Ship Better

CI/CD Deployment

Integrate Kestra into CI/CD pipelines to automate the deployment of workflows (Terraform, GitLab Actions, GitLab, Jenkins…).

Production made easy, no more production plan

Kestra supports flow dependencies to define the execution order based on their interdependence.

Event-Based

Flow execution based on events from the core or plugins, such as the result of other flows in real-time, detection of files from SFTP or Google Cloud Storage, or results of an SQL query.

Infinity of triggers

Endless possibilities to start a flow through API, using a webhook, waiting for a trigger, or simply starting directly from the Web UI.

Monitoring

Dashboards and metrics directly in the User Interface.

Error Handling

Handle errors automatically and retry failed tasks.

Notifications

Alerting configuration directly in the UI to alert when workflow tasks are completed, have errors or delays, or for any other important event.

Large Data Processing

Massive data volume handling with high performance using partitioning and batch processing techniques.

Micro-Batch for Real-Time

All the benefits of a real-time system without maintenance and complexity costs by collecting data at regular intervals and processing them in micro-batch.

No single point of failure

Horizontal and vertical scaling without worrying about resource allocation.

Performance Gains

Better performance with JVM (Java Virtual Machine) technology.

Centralized Data Control for Improved Efficiency

Data at Heart with Internal Storage

Abstraction of Files

The internal Storage feature abstracts files, enabling each task to produce or consume files without needing to know the server's current location.

Stateless Servers

Allows easy destruction, restart from scratch or restart a previous execution without any hassle.

Metadata Storage

Metadata from the flow is stored on a database and Kestra's Internal Storage for transparent file systems.

Strongly Typed

Ensure each piece of data is the right type and well-defined, a date must be a date, an int must be an int, and so on…

Amazon Ion Integration

Handles more types than JSON, to enable easy mixing of tasks usage without any pain.

Communication Between Tasks

Each task can easily communicate with all others, making it simple to mix tasks usage without any problems.

Task Switch flexibility

All switch between tasks, such as BigQuery to MySQL or BigQuery to Redshift, without needing specific operators.

Security and high availability

Take Kestra to the next level with the Enterprise Edition 🚀

Ensure scalability and high availability with Kafka and ElasticSearch Features available on the Enterprise Edition to eliminate all points of failure. Kestra's architecture is designed to handle high volumes of data and to ensure that workflows are processed reliably by default.

Secure your Kestra cluster with a single sign-on using your Open ID provider and control user and group access with fine-grained ACL.

Configure a namespace with task defaults, variables, and secrets to automatically configure all flows.

A design of the features of Kestra's enterprise edition with SSO connection, Role Based Access Control, Kafka and Elasticsearch integration

Service account

Create service accounts allowing to trigger workflows for external systems.

Secrets

Integrate your secret manager to ensure the security of your passwords and keys.

Audit Log

Audit all the resources created in one instance.

Learn more Contact us