Download icon
Request icon
Write icon
RunPipeline icon
Log icon
Flow icon
SlackIncomingWebhook icon

Apache Beam Distributed Pipeline on Flink (Portable Runner)

Run a Python Apache Beam pipeline on a distributed Flink portable runner with Kestra. Event-driven, with pre-submit checks, retries, and Slack alerts.

Categories
Data

More Data Blueprints

AI Document Data Extraction: Parse PDFs and Web Pages into Structured JSON with OpenAI

Turn any PDF, web page, or text document into structured JSON with OpenAI GPT-4o, then store the results in PostgreSQL and Slack.

Download icon
Script icon
ChatCompletion icon
Queries icon
SlackIncomingWebhook icon
AI Data
Run Parallel ETL Ingestion with Airbyte to Sync Multiple Data Sources

Trigger multiple Airbyte connection syncs in parallel from a single Kestra flow to cut total ingestion time.

Parallel icon
Sync icon
Data
Generate and Execute SQL Queries from Natural Language Using OpenAI GPT-4o

Turn plain-English questions into PostgreSQL queries with OpenAI GPT-4o, grounded on schema only so no row data ever leaves your database.

Queries icon
ChatCompletion icon
If icon
IonToJson icon
Log icon
AI Data
See How

New to Kestra?

Use blueprints to kickstart your first workflows.

Get Started