Process partitions in parallel in Python, report outputs and metrics about number of rows and processing time for all partitioned files | Kestra

Source

About this blueprint

CoreData

Script

Docker

For Each

More related blueprints

Cache a computationally expensive task in an ETL pipeline using the taskCache property

GPU-accelerated Python script with Modal

Run DDL queries and load data to Postgres