Home
Blueprints

Process Pub/Sub Messages into Postgres in Real Time

Stream Google Cloud Pub/Sub messages into Postgres in real time with Kestra. One governed execution per message, safe upserts, and Teams alerts on failure.

More Cloud Blueprints

Extract data, mask sensitive columns using DuckDB and load it to BigQuery

Extract CSV data, mask PII columns with DuckDB SQL, then load the anonymized result into BigQuery.

CloudData

High-Performance Computing, Run Parallel Python Workloads on AWS Batch with ECS Fargate

Provision AWS Batch on ECS Fargate with Terraform, then run parallel Python workloads on it from one Kestra flow.

CloudCoreInfrastructure

Enterprise Edition

Autoscale EMR Serverless Spark on a CloudWatch Backlog

Watch a CloudWatch backlog metric and fire an EMR Serverless Spark job only when work is pending.

CloudData

Stream JSON and Application Events to AWS Kinesis Data Streams at Scale

Publish inline events and API-sourced JSON to AWS Kinesis Data Streams in bulk, with automatic ION conversion.

Cloud

Multi-cloud deployment pipeline with Docker, ngrok, GCP Cloud Run, and Azure Container Apps

Build a Docker image from a GitHub repo and deploy it to local, GCP Cloud Run, or Azure Container Instances from one declarative flow.

CloudInfrastructure

Publish Application and System Events to AWS EventBridge for Event-Driven Architectures

Publish custom application and system events to AWS EventBridge using inline definitions or bulk JSON payloads.

Cloud

More Data Blueprints

Build an ETL Pipeline with Airbyte Cloud and dbt Cloud for SaaS Analytics

Run Airbyte Cloud syncs in parallel, then trigger a dbt Cloud transformation job once the data lands.

Data

Generate and Execute SQL Queries from Natural Language Using OpenAI GPT-4o

Turn plain-English questions into PostgreSQL queries with OpenAI GPT-4o, grounded on schema only so no row data ever leaves your database.

AIData

Trigger an Airflow DAG

Trigger an Apache Airflow DAG from Kestra and wait for it to finish.

Data

AI Document Data Extraction: Parse PDFs and Web Pages into Structured JSON with OpenAI

Turn any PDF, web page, or text document into structured JSON with OpenAI GPT-4o, then store the results in PostgreSQL and Slack.

AIData

Run a Scheduled ETL Sync with Airbyte Cloud

Trigger an Airbyte Cloud connection sync on a recurring schedule so your data lands fresh without manual runs.

Data

Sync Postgres records to Algolia index

Incrementally push freshly updated Postgres rows into an Algolia search index every five minutes.

BusinessData

New to Kestra?

Use blueprints to kickstart your first workflows.

Get Started