Databricks Query
CertifiedRun a SQL query on Databricks
Databricks Query
Run a SQL query on Databricks
Executes a SQL statement on a Databricks cluster or SQL warehouse through the JDBC driver. Renders connection values and SQL from the RunContext, then streams results to internal storage as an ION text file. Arrow is disabled with the Databricks JDBC driver on Java 21, which may reduce fetch throughput.
type: io.kestra.plugin.databricks.sql.QueryExamples
id: databricks_sql_query
namespace: company.team
tasks:
- id: sql_query
type: io.kestra.plugin.databricks.sql.Query
accessToken: "{{ secret('DATABRICKS_TOKEN') }}"
host: <your-host>
httpPath: <your-httpPath>
sql: SELECT 1
Properties
host *string
Databricks host
Server hostname without protocol, e.g. adb-12345.7.azuredatabricks.net
httpPath *string
Databricks cluster HTTP Path
HTTP Path from the cluster connection details (Advanced options → JDBC/ODBC).
sql *string
SQL query to execute
SQL text rendered with Flow variables before execution
accessToken string
Databricks access token
Personal Access Token passed as the JDBC password; render from secrets
assets
Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.
io.kestra.core.models.assets.AssetsDeclaration
IGNOREFAILWARNAsset failure behavior
Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.
Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.
The assets consumed as inputs.
io.kestra.core.models.assets.AssetIdentifier
1The assets produced as outputs.
io.kestra.plugin.ee.assets.Dataset
1150{}1150io.kestra.plugin.ee.assets.File
1150{}1150io.kestra.plugin.ee.assets.Table
1150{}1150io.kestra.plugin.ee.assets.VM
1150{}1150io.kestra.core.models.assets.External
1150{}1150io.kestra.core.models.assets.Custom
11501Custom asset type
{}1150catalog string
Catalog used for the connection
Sets ConnCatalog on the JDBC URL when provided
properties object
Additional JDBC properties
Optional map merged into the Databricks driver properties after authentication
schema string
Schema used for the connection
Sets ConnSchema on the JDBC URL when provided
timeZoneId string
Time zone for temporal values
Timezone used when converting date/time columns; defaults to the worker JVM time zone
Outputs
size integer
Number of fetched rows
uri string
uriResult file URI
Internal storage URI of the ION text file containing fetched rows
Metrics
fetch.size counter
Query result size
