Understand Kestra's Architecture, Data Handling, and Templating

This section lists key concepts and templating expressions. You can treat this section as a lookup reference anytime you need more details about a specific concept or expression.

Explore Key Concepts

Namespace Files

Manage Namespace Files in Kestra and use them in your flows. Store scripts, configs, and assets at the namespace level for centralized file management.

Revision

Track and manage flow versions in Kestra with built-in revision history. Roll back to any previous version to undo changes and maintain reliability.

Secrets

Store and access sensitive information securely in Kestra. Use Secrets to protect API keys, passwords, and credentials without exposing plain-text values.

Key Value (KV) Store

Build stateful workflows with the Kestra KV Store. Persist and share key-value pairs across flows and executions for dynamic configuration and shared state.

Pebble Templating Engine

Dynamically render variables, inputs, and outputs in Kestra using Pebble templating. Use expressions to build flexible, data-driven workflows.

Blueprints

Explore Kestra Blueprints — ready-to-use workflow templates that help you get started faster. Browse community and Enterprise blueprints for any automation.

Backfill

Replay missed schedule intervals with Kestra Backfills. Rerun historical executions between a start and end date to reprocess data or recover from gaps.

Replay

Replay Kestra workflow executions from any chosen task run. Re-trigger failed or incomplete executions without starting from scratch for faster recovery.

Data storage and processing

Understand how Kestra stores and processes task data. Learn about internal storage, file handling, and how outputs are passed between tasks in your workflows.

Caching

Speed up repeated tasks with file caching in Kestra. Use the WorkingDirectory task to cache dependencies and skip redundant downloads across flow executions.

File Access in Kestra

Access local and namespace files in Kestra using the universal file protocol. Learn how to read, write, and share files between tasks and namespaces.

System Flows

Automate platform maintenance with System Flows in Kestra. Schedule cleanup, monitoring, and admin tasks that run on a fixed cadence automatically.

System Labels & Hidden Labels

Use system and hidden labels in Kestra for admin metadata. Understand how internal labels differ from user labels and how they affect filtering.

Was this page helpful?