Zendesk to DuckDB with dlt and Kestra

Trigger multiple Airbyte connection syncs in parallel from a single Kestra flow to cut total ingestion time.

Forecast 7-day demand with OpenAI GPT-4o, auto-generate purchase orders for stockout-risk SKUs, and log them to PostgreSQL every 6 hours.

Run parallel Airbyte syncs, then transform raw data with dbt Core, all in one orchestrated ELT pipeline.

Incrementally push freshly updated Postgres rows into an Algolia search index every five minutes.

Run Airbyte Cloud syncs in parallel, then trigger a dbt Cloud transformation job once the data lands.

Trigger an Apache Airflow DAG from Kestra and wait for it to finish.

Ingest Zendesk data into DuckDB using dlt