Home
Blueprints

Process partitions in parallel in Python, report outputs and metrics

Process data partitions in parallel with Python in Kestra. Fan out files into isolated Docker containers and track row counts and processing time as metrics.

More Core Blueprints

Reduce LLM API Costs with a Redis Semantic Cache for Repeated Questions

Cache LLM answers in Redis so repeated questions are served instantly and OpenAI is only called on a genuine cache miss.

AICore

Run a Python script in a Kubernetes pod

Run a Python script inside a Kubernetes pod with declarative CPU and memory limits, straight from a Kestra flow.

CoreInfrastructure

Layered Error Handling with Retries and KV Context

A deliberately failing flow that demonstrates block level errors, flow level errors, automatic retries, and KV context for alerting flows.

Core

Route AI Requests to the Optimal Model Based on Query Classification

Classify every prompt with OpenAI, then route it to the best-fit LLM across Anthropic, Gemini, Perplexity, and OpenAI for quality and cost.

AICore

Infrastructure Automation workflow example: Getting started with Kestra

Build a Docker image, run it, and provision files with Terraform in one declarative Kestra pipeline.

CoreInfrastructure

Advanced Scheduling Automation, Run Tasks Only on Business Days by Country

Run scheduled tasks only on business days using a Python calendar check that skips weekends and country-specific public holidays.

Core

More Data Blueprints

Build an ETL Pipeline with Parallel Airbyte Syncs and dbt Core Transformations

Run parallel Airbyte syncs, then transform raw data with dbt Core, all in one orchestrated ELT pipeline.

Data

Run Parallel ETL Ingestion with Airbyte to Sync Multiple Data Sources

Trigger multiple Airbyte connection syncs in parallel from a single Kestra flow to cut total ingestion time.

Data

Sync Postgres records to Algolia index

Incrementally push freshly updated Postgres rows into an Algolia search index every five minutes.

BusinessData

Build an ETL Pipeline with Airbyte Cloud and dbt Cloud for SaaS Analytics

Run Airbyte Cloud syncs in parallel, then trigger a dbt Cloud transformation job once the data lands.

Data

Trigger an Airflow DAG

Trigger an Apache Airflow DAG from Kestra and wait for it to finish.

Data

Generate and Execute SQL Queries from Natural Language Using OpenAI GPT-4o

Turn plain-English questions into PostgreSQL queries with OpenAI GPT-4o, grounded on schema only so no row data ever leaves your database.

AIData

New to Kestra?

Use blueprints to kickstart your first workflows.

Get Started