List icon
If icon
Script icon
Docker icon
Query icon
AwsCLI icon
Schedule icon

Ingest data to AWS S3 with Python, Apache Iceberg, AWS Glue and Athena

Detect new S3 files hourly, clean CSVs with Python and awswrangler, then upsert into an Apache Iceberg table on AWS Glue and Athena with Kestra.

Categories
Data

More Data Blueprints

AI-Powered Inventory Demand Forecasting, Auto-Generate Purchase Orders with OpenAI
Parallel icon
Request icon
ChatCompletion icon
Script icon
If icon
ForEach icon
+3
AIBusinessData
Run Parallel ETL Ingestion with Airbyte to Sync Multiple Data Sources
Parallel icon
Sync icon
Data
AI Document Data Extraction: Parse PDFs and Web Pages into Structured JSON with OpenAI
Download icon
Script icon
ChatCompletion icon
Queries icon
SlackIncomingWebhook icon
AIData
See How

New to Kestra?

Use blueprints to kickstart your first workflows.

Get Started