Script icon
Docker icon
ForEach icon

Process partitions in parallel in Python, report outputs and metrics

Process data partitions in parallel with Python in Kestra. Track row counts and processing time metrics across all partitioned files in a single workflow.

Categories
CoreData

More Core Blueprints
Route AI Requests to the Optimal Model Based on Query Classification
ChatCompletion icon
Switch icon
ChatCompletion icon
ChatCompletion icon
ChatCompletion icon
AICore
Export Kestra audit logs as a CSV file and send out via Email.
AuditLogShipper icon
FileLogExporter icon
IonToCsv icon
MailSend icon
Schedule icon
Core
CI/CD with GitHub Webhooks, Process Pull Request Events and Test Locally with JSON Payloads
Return icon
Script icon
Docker icon
Webhook icon
Expression icon
CoreInfrastructure

More Data Blueprints
AI-Powered Inventory Demand Forecasting — Auto-Generate Purchase Orders with OpenAI
Parallel icon
Request icon
ChatCompletion icon
Script icon
If icon
ForEach icon
+3
AIBusinessData
Run Parallel ETL Ingestion with Airbyte to Sync Multiple Data Sources
Parallel icon
Sync icon
Data
Extract data, transform it, and load it in parallel to S3 and Postgres — in less than 7 seconds!
Download icon
JsonToIon icon
IonToJson icon
FileTransform icon
Parallel icon
Sequential icon
+4
Data
See How

New to Kestra?

Use blueprints to kickstart your first workflows.

Get Started