Script icon
Docker icon
ForEach icon

Process partitions in parallel in Python, report outputs and metrics

Process data partitions in parallel with Python in Kestra. Track row counts and processing time metrics across all partitioned files in a single workflow.

Categories
CoreData

More Core Blueprints
Advanced Scheduling Automation, Run Tasks Only on Business Days by Country
Commands icon
Process icon
Log icon
Schedule icon
Core
Automatically Ship Workflow and System Logs to AWS CloudWatch
LogShipper icon
LogExporter icon
Schedule icon
CloudCoreSystem
Convert Natural Language Prompts to Structured Todoist Tasks with Deepseek AI
ChatCompletion icon
ForEach icon
Request icon
AIBusinessCore

More Data Blueprints
Sync Postgres records to Algolia index
Trigger icon
ForEach icon
Index icon
Query icon
postgresql icon
BusinessData
Build an ETL Pipeline with Airbyte Cloud and dbt Core for SaaS Analytics
Parallel icon
Sync icon
WorkingDirectory icon
Clone icon
Build icon
Docker icon
Data
Build an ETL Pipeline with Parallel Airbyte Syncs and dbt Core Transformations
Parallel icon
Sync icon
WorkingDirectory icon
Clone icon
Build icon
Docker icon
Data
See How

New to Kestra?

Use blueprints to kickstart your first workflows.

Get Started