WorkingDirectory icon
Clone icon
Commands icon
Docker icon
Query icon
Trigger icon

Event-driven data ingestion to AWS S3 data lake managed by Apache

Trigger a Kestra pipeline on new S3 files, ingest them into an Apache Iceberg table with Python, then MERGE and OPTIMIZE the data using Amazon Athena.

Categories
Data

More Data Blueprints

AI-Powered Inventory Demand Forecasting, Auto-Generate Purchase Orders with OpenAI
Parallel icon
Request icon
ChatCompletion icon
Script icon
If icon
ForEach icon
+3
AIBusinessData
Run a Scheduled ETL Sync with Airbyte Cloud
Sync icon
Schedule icon
Data
Generate and Execute SQL Queries from Natural Language Using OpenAI GPT-4o
Queries icon
ChatCompletion icon
If icon
IonToJson icon
Log icon
AIData
See How

New to Kestra?

Use blueprints to kickstart your first workflows.

Get Started