DigitalOcean
DigitalOcean is the developer cloud, offering droplets, managed databases, and Kubernetes. With Kestra's dedicated plugin, teams orchestrate the whole account with event-driven flows.
Dremio
Dremio queries data where it lives, across object storage and databases, without copying it. Kestra schedules, triggers and chains that SQL with the rest of the data stack.
About
Two plugins cover Dremio: one for Dremio SQL and one for any Arrow Flight SQL endpoint. The data lakehouse orchestration tutorial shows a full flow that runs dbt on Dremio, queries the models and processes the output in Python.
Dremio + Kestra: the data lakehouse, orchestrated
Dremio SQL as a flow task
Query and Queries run SQL against Dremio over JDBC and store the results in Kestra internal storage for the next task.
Flows that react to lakehouse data
The Trigger polls a Dremio query and starts a flow when rows come back, for example when a KPI falls outside its expected range.
dbt, Dremio and Python in one flow
Build dbt models on Dremio, query the result and hand it to a Python script with Polars, all in a single declarative flow.
Arrow Flight SQL beyond Dremio
The same Query, Queries and Trigger tasks work with any database that exposes an Apache Arrow Flight SQL endpoint.
