Script icon
Docker icon
ForEach icon

Process partitions in parallel in Python, report outputs and metrics

Process data partitions in parallel with Python in Kestra. Track row counts and processing time metrics across all partitioned files in a single workflow.

Categories
CoreData

More Core Blueprints
Export Kestra audit logs as a CSV file and send out via Email.
AuditLogShipper icon
FileLogExporter icon
IonToCsv icon
MailSend icon
Schedule icon
Core
Getting started with Kestra — a Business Processes workflow example
SlackIncomingWebhook icon
Pause icon
Request icon
Getting StartedBusinessCore
CI/CD with GitHub Webhooks, Process Pull Request Events and Test Locally with JSON Payloads
Return icon
Script icon
Docker icon
Webhook icon
Expression icon
CoreInfrastructure

More Data Blueprints
Build an ETL Pipeline from a REST API Using Python, Polars, and DuckDB
Request icon
Script icon
Docker icon
Query icon
Data
Build an ETL Pipeline with Airbyte Cloud and dbt Cloud for SaaS Analytics
Parallel icon
Sync icon
TriggerRun icon
Data
Build an ETL Pipeline with Airbyte Cloud and dbt Core for SaaS Analytics
Parallel icon
Sync icon
WorkingDirectory icon
Clone icon
Build icon
Docker icon
Data
See How

New to Kestra?

Use blueprints to kickstart your first workflows.

Get Started