Commands icon
Docker icon
Trigger icon

Detect New Files in S3 and process them in Python

Trigger a Kestra workflow on new S3 file detection. Download files to internal storage and process them with Python for automated data pipeline execution.

Categories
CloudData

More Cloud Blueprints
Ansible Scalability, Deploy Configuration Files to Multiple Servers at Scale
AwsCLI icon
AnsibleCLI icon
CloudInfrastructure
Stream JSON and Application Events to AWS Kinesis Data Streams at Scale
PutRecords icon
Download icon
JsonToIon icon
Cloud
Stream kestra audit logs from a Kafka topic to BigQuery for analytics and
Consume icon
FileTransform icon
IonToAvro icon
Load icon
Schedule icon
Cloud

More Data Blueprints
Build an ETL Pipeline with Parallel Airbyte Syncs and dbt Core Transformations
Parallel icon
Sync icon
WorkingDirectory icon
Clone icon
Build icon
Docker icon
Data
Build an ETL Pipeline from a REST API Using Python, Polars, and DuckDB
Request icon
Script icon
Docker icon
Query icon
Data
Automate Cross-Cloud ETL from Azure Blob Storage to BigQuery with dbt Cloud
ForEach icon
Load icon
TriggerRun icon
Trigger icon
Data
See How

New to Kestra?

Use blueprints to kickstart your first workflows.

Get Started