Script icon
Docker icon
ForEach icon

Process partitions in parallel in Python, report outputs and metrics about number of rows and processing time for all partitioned files

Categories
CoreData

More Core Blueprints
Getting started with Kestra — a Business Automation workflow example
WorkingDirectory icon
Queries icon
IonToCsv icon
IonToExcel icon
Getting StartedBusinessCore
CI/CD with GitHub Webhooks, Process Pull Request Events and Test Locally with JSON Payloads
Return icon
Script icon
Docker icon
Webhook icon
Expression icon
CoreInfrastructure
High-Performance Computing, Run Parallel Python Workloads on AWS Batch with ECS Fargate
WorkingDirectory icon
Clone icon
TerraformCLI icon
Script icon
Docker icon
Parallel icon
+2
CloudCoreInfrastructure

More Data Blueprints
Build an ETL Pipeline from a REST API Using Python, Polars, and DuckDB
Request icon
Script icon
Docker icon
Query icon
Data
Build an ETL Pipeline with Airbyte Cloud and dbt Cloud for SaaS Analytics
Parallel icon
Sync icon
TriggerRun icon
Data
Run Apify actor and update Notion
Run icon
Get icon
Update icon
Data
See How

New to Kestra?

Use blueprints to kickstart your first workflows.

Get Started