WorkingDirectory icon
Script icon
Docker icon

Pandas ETL - passing data between Python script tasks running in separate containers

Orchestrate a multi-step pandas ETL in Python on Kestra. Use WorkingDirectory to share CSVs between Docker-isolated script tasks and capture outputs.

Categories
Data

More Data Blueprints

Run a Scheduled ETL Sync with Airbyte Cloud

Trigger an Airbyte Cloud connection sync on a recurring schedule so your data lands fresh without manual runs.

Sync icon
Schedule icon
Data
Build an ETL Pipeline with Airbyte Cloud and dbt Cloud for SaaS Analytics

Run Airbyte Cloud syncs in parallel, then trigger a dbt Cloud transformation job once the data lands.

Parallel icon
Sync icon
TriggerRun icon
Data
Generate and Execute SQL Queries from Natural Language Using OpenAI GPT-4o

Turn plain-English questions into PostgreSQL queries with OpenAI GPT-4o, grounded on schema only so no row data ever leaves your database.

Queries icon
ChatCompletion icon
If icon
IonToJson icon
Log icon
AI Data
See How

New to Kestra?

Use blueprints to kickstart your first workflows.

Get Started