Event Driven Postgres to Databricks Pipeline with Data Quality Checks

Event driven Kestra pipeline that reacts to new Postgres rows, lands data in S3 and Databricks in parallel, runs a Databricks job, and validates results with pandas.