Databricks Query

Databricks Query

Certified

Run a SQL query on Databricks

Executes a SQL statement on a Databricks cluster through the JDBC driver. Renders connection values and SQL from the RunContext, then streams results to internal storage as an Ion text file. Arrow is disabled with the Databricks JDBC driver on Java 21, which may reduce fetch throughput.

yaml
type: io.kestra.plugin.databricks.sql.Query
yaml
id: databricks_sql_query
namespace: company.team

tasks:
  - id: sql_query
    type: io.kestra.plugin.databricks.sql.Query
    accessToken: "{{ secret('DATABRICKS_TOKEN') }}"
    host: <your-host>
    httpPath: <your-httpPath>
    sql: SELECT 1
Properties

Databricks host

Server hostname without protocol, e.g. adb-12345.7.azuredatabricks.net

Databricks cluster HTTP Path

HTTP Path from the cluster connection details (Advanced options → JDBC/ODBC).

SQL query to execute

SQL text rendered with Flow variables before execution

Databricks access token

Personal Access Token passed as the JDBC password; render from secrets

Catalog used for the connection

Sets ConnCatalog on the JDBC URL when provided

Reference (ref) of the pluginDefaults to apply to this task.

Additional JDBC properties

Optional map merged into the Databricks driver properties after authentication

Schema used for the connection

Sets ConnSchema on the JDBC URL when provided

Time zone for temporal values

Timezone used when converting date/time columns; defaults to the worker JVM time zone

Number of fetched rows

Formaturi

Result file URI

Internal storage URI of the Ion text file containing fetched rows

Query result size

More Plugins in this Category

Liquibase
Liquibase

Tasks that run Liquibase change management commands.

Data

2 tasks

PostgreSQL
PostgreSQL

Tasks that connect to PostgreSQL via JDBC to run queries and loads.

Data

6 tasks

25 blueprints