480+ Blueprints, ready to build.

The first step is always the hardest. Search or browse to kick-start your next flow.

AI Business Cloud Core Data Infrastructure

482 Blueprints

Sort by:

Apache Beam Distributed Pipeline on Flink (Portable Runner)

Submit a Python Apache Beam pipeline to a distributed Flink portable runner via a JobServer, triggered after upstream ingestion succeeds.

Apache Beam Python YAML CSV Transform

Use the Beam YAML framework with the Python SDK to read, filter, and rewrite a daily orders CSV, backfill-safe and with a non-injectable threshold.

Apache Beam Word Count with the DIRECT Runner

Run the canonical Apache Beam word-count pipeline locally with the DIRECT runner over a real ingested text file.

Auto Resubmit Failed Executions with Loop Protection

Automatically re-execute FAILED or WARNING executions via a Flow trigger and Subflow, with label based loop protection.

Automate Cross-Cloud ETL from Azure Blob Storage to BigQuery with dbt Cloud

Event-driven cross-cloud ETL that loads new Azure Blob CSV files into BigQuery and triggers a dbt Cloud transformation job.

Automatically Ship Workflow and System Logs to AWS CloudWatch

Ship Kestra workflow and system logs to AWS CloudWatch on a daily schedule for centralized monitoring, auditing, and observability.

Autoscale EMR Serverless Spark on a CloudWatch Backlog

Watch a CloudWatch backlog metric and fire an EMR Serverless Spark job only when work is pending.

Azure Batch Cost Guardrail with Storage Lifecycle Cleanup

Query Azure Monitor for idle Batch pool nodes, scale the pool down automatically when it is over-provisioned, and purge cold scratch blobs on the same hourly run.

BigQuery Partition-Aware Incremental Refresh

Refresh only the BigQuery partitions that changed by loading each day's GCS files into its matching partition with WRITE_TRUNCATE.

Chain Blob Storage, an Azure Function, Service Bus, and Data Factory

Chain Blob Storage, an Azure Function, Service Bus, and Data Factory in one execution, from file arrival to warehouse load, with a Teams notification.

Deploy an Azure Function from Git and Chain a Logic App

Clone an Azure Function from Git, deploy it with the Azure CLI, then chain an Azure Logic App and fetch its result.

Export Kestra audit logs as a CSV file and send out via Email.

Ship Kestra audit logs on a weekly schedule, convert them to CSV, and email the report automatically.

Fan Out S3 Object Events to Lambda and SNS

React to new Amazon S3 objects and fan out by file type, routing JSON to AWS Lambda and everything else to SNS, with a Slack notification.

Glue ETL, Athena Validation, DynamoDB Cache

Run a Glue ETL job, validate the output with Athena, then cache the headline KPI in DynamoDB.

High-Performance Computing, Run Parallel Python Workloads on AWS Batch with ECS Fargate

Provision AWS Batch on ECS Fargate with Terraform, then run parallel Python workloads on it from one Kestra flow.

Microservice orchestration: invoke multiple AWS Lambda functions in parallel

Invoke multiple AWS Lambda functions in parallel, target specific versions and aliases, pass custom payloads, and parse the JSON results.

Monitor Azure Event Hub Volume and Alert on a Silent Drop

Poll an Azure Event Hub on a schedule and page on-call automatically when the event volume in the window drops below the expected floor.

Publish Application and System Events to AWS EventBridge for Event-Driven Architectures

Publish custom application and system events to AWS EventBridge using inline definitions or bulk JSON payloads.

Stream JSON and Application Events to AWS Kinesis Data Streams at Scale

Publish inline events and API-sourced JSON to AWS Kinesis Data Streams in bulk, with automatic ION conversion.

Stream Kestra audit logs from Kafka to BigQuery

Stream Kestra audit logs from a Kafka topic into Google BigQuery for analytics, monitoring, and compliance reporting.

Stream Pub/Sub Events into BigQuery with Micro-Batching

A Pub/Sub trigger micro-batches streaming messages and appends them to a raw BigQuery table as newline-delimited JSON, staying under DML limits.

Take a VM Snapshot and Register It as an Asset

Snapshot a VM and register the backup as a typed snapshot asset with retention metadata in the Kestra catalog.

Upgrade Server Fleets Selected by Asset Metadata

Find servers with outdated Python via asset metadata queries, upgrade them, refresh the catalog, and AI-analyze any failure.

Weekly Azure Blob Backup Archive with Gated Expiry Cleanup

List a container, copy each blob into a dated archive prefix, notify Slack, then pause before deleting anything past retention, so only the destructive step waits on a named reviewer.