ForEach icon
Script icon
Docker icon

Transform data from CSV files with Pandas in Python containers (in parallel)

Fan out a list of CSV files and transform each one in parallel using isolated Python Pandas scripts in Docker, orchestrated declaratively with Kestra.

Categories
Data

More Data Blueprints

AI Document Data Extraction: Parse PDFs and Web Pages into Structured JSON with OpenAI

Turn any PDF, web page, or text document into structured JSON with OpenAI GPT-4o, then store the results in PostgreSQL and Slack.

Download icon
Script icon
ChatCompletion icon
Queries icon
SlackIncomingWebhook icon
AI Data
Build an ETL Pipeline with Parallel Airbyte Syncs and dbt Core Transformations

Run parallel Airbyte syncs, then transform raw data with dbt Core, all in one orchestrated ELT pipeline.

Parallel icon
Sync icon
WorkingDirectory icon
Clone icon
Build icon
Docker icon
Data
Sync Postgres records to Algolia index

Incrementally push freshly updated Postgres rows into an Algolia search index every five minutes.

Trigger icon
ForEach icon
Index icon
Query icon
postgresql icon
Business Data
See How

New to Kestra?

Use blueprints to kickstart your first workflows.

Get Started