Download icon
Write icon
RunPipeline icon
Log icon
Schedule icon
SlackIncomingWebhook icon

Apache Beam Python YAML CSV Transform

Read, filter, and rewrite a daily orders CSV with the Apache Beam YAML framework and Python SDK on Kestra. Backfill-safe, with retry, alerting, and a safe threshold.

Categories
Data

More Data Blueprints

AI Document Data Extraction: Parse PDFs and Web Pages into Structured JSON with OpenAI

Turn any PDF, web page, or text document into structured JSON with OpenAI GPT-4o, then store the results in PostgreSQL and Slack.

Download icon
Script icon
ChatCompletion icon
Queries icon
SlackIncomingWebhook icon
AI Data
Run Parallel ETL Ingestion with Airbyte to Sync Multiple Data Sources

Trigger multiple Airbyte connection syncs in parallel from a single Kestra flow to cut total ingestion time.

Parallel icon
Sync icon
Data
Trigger an Airflow DAG

Trigger an Apache Airflow DAG from Kestra and wait for it to finish.

TriggerDagRun icon
Data
See How

New to Kestra?

Use blueprints to kickstart your first workflows.

Get Started