Getting started with Kestra
Start building with Kestra — Automate Everything Everywhere All at Once.
Get Started!Frequently Asked Questions
General Questions
Kestra is an open-source orchestrator designed to bring Infrastructure as Code (IaC) best practices to all workflows — from those orchestrating mission-critical operations, business processes, and data pipelines to simple Zapier-style automation. Built with an API-first philosophy, Kestra enables users to define and manage data pipelines through a simple YAML configuration file. This approach frees you from being tied to a specific client implementation, allowing for greater flexibility and easier integration with various tools and services.
A declarative orchestrator is a system that allows you to define and manage complex workflows using a high-level, descriptive language. Instead of specifying the exact steps and sequences to achieve a specific outcome, a declarative orchestrator lets you define the desired end state and the system figures out how to reach it.
Kestra is a declarative orchestrator designed for managing all kinds of workflows. It uses YAML (Yet Another Markup Language) to define workflows in a human-readable and structured format. Kestra workflows consist of tasks and triggers that represent various data processing operations, connected by data dependencies and control flow structures.
By using a declarative approach, Kestra simplifies the development, maintenance, and scalability of workflows. It allows you to focus on the high-level goals and objectives of your data workflows, while Kestra takes care of executing the tasks and handling errors, retries, and parallelism.
Some key benefits of using Kestra as a declarative orchestrator include:
- Improved readability and maintainability: Declarative workflows are easier to understand and modify, making it simpler for teams to collaborate and maintain their data pipelines over time.
- Enhanced flexibility: Declarative orchestration enables easy modification and extension of workflows as requirements change, without the need for extensive refactoring.
Kestra is perfect for data engineers, developers, data scientists, and anyone who needs to process, manage, and orchestrate workflows across multiple systems.
Features and Functionality
Kestra offers a wide range of features, including:
- Intuitive flow creation with a built-in code editor
- Powerful and flexible task execution with support for parallelism and retries
- Comprehensive plugin ecosystem for easy integration with various services and systems
- Advanced flow and task monitoring with metrics, logs, and notifications
- Highly extensible and customizable architecture
Yes, Kestra allows developers to create custom plugins to add new tasks and integrations that suit their specific requirements.
Kestra flows are primarily defined in YAML, which provides a simple and human-readable syntax for describing your data workflows. In addition to YAML, you can also use various scripting languages within your tasks, such as Python, R, Node.js, Julia, Ruby, Shell, or PowerShell, to perform custom operations and data transformations.
Furthermore, Kestra supports Docker, which enables you to execute tasks using any language, expanding the range of possibilities for your workflows. This flexibility allows you to leverage the power of different programming languages within your Kestra flows to suit your specific requirements.
Getting Started
To get started with Kestra, follow the Getting Started Guide on the Kestra website. This guide will walk you through the installation and configuration process, as well as provide an introduction to creating your first flows and tasks.
Kestra is designed to be easy to install and set up. The installation process involves following the official documentation, which provides step-by-step instructions on how to get started with Kestra on various platforms, including Docker, Kubernetes, and Helm. We are also available on our Slack channel to provide assistance and answer any questions you might have during the installation process.
Yes, Kestra has a growing community. You can join the Kestra Slack channel to ask questions, share your experience, and connect with other users and developers.
Pricing and Licensing
Yes, Kestra is an open-source project. The source code is available on GitHub under the Apache 2.0 license.
Kestra is free to use as an open-source project. However, there might be additional costs related to hosting, infrastructure, and any third-party services you choose to integrate with Kestra.
Enterprise Edition
The Kestra Enterprise Edition provides enhanced features designed to meet the needs of large-scale and complex organizations. These features include:
- Improved scalability: Allows you to scale up your Kestra deployment to handle a larger number of flows, tasks, and users.
- Enhanced security: Offers additional security features such as encryption, access control, single sign-on (SSO) integration, fine-grained management permissions, and audit logs.
- Dedicated support: You'll have access to dedicated support from the Kestra team to help you resolve any issues and ensure a smooth deployment.
- Customizable dashboard: Includes a customizable dashboard that provides advanced monitoring and analytics capabilities for better insights into your data workflows.
- User management: Enables you to easily add and manage users, ensuring that the right people have access to the appropriate resources and workflows within your organization.
To get access to the Kestra Enterprise Edition, please contact us through our Slack channel or Talk to us. We will provide you with the necessary information and guide you through the process of setting up the Enterprise Edition.
Yes, there are additional licensing fees for using the Kestra Enterprise Edition. The fees depend on the size of your organization and the specific features you require. To get more information about pricing, please get in touch with the Kestra team.
Miscellaneous
Kestra stands out from other data orchestration platforms due to its focus on ease of use thanks to declarative language YAML, powerful features, and a growing ecosystem of plugins. The user-friendly interface and robust architecture make it an excellent choice for orchestrating complex data workflows across various systems and services.
YAML's simplicity and readability make it easy to understand and maintain your data workflows. Kestra provides extensive support for various YAML features, such as variables, loops, and conditions, allowing you to create complex workflows without the need for a separate programming language. If you require more advanced functionality, you can always use scripting languages like Python, JavaScript, or Bash within your tasks to extend your flows' capabilities.
Contributions to Kestra are always welcome! You can contribute by submitting bug reports, feature requests, or pull requests on the GitHub repository. You can also join the community on Slack to discuss ideas and collaborate with other developers.
