Detect New Files in S3 and process them in Python | Kestra

Source

About this blueprint

CloudData

Commands

Docker

Trigger

More related blueprints

Process a file from S3 only if it changed since the last execution

Anomaly detection using DuckDB SQL query and S3 file event trigger, sending a CSV file attachment via email if anomalies are detected

Extract data, mask sensitive columns using DuckDB and load it to BigQuery