Query
type: "io.kestra.plugin.jdbc.snowflake.Query"
Query a Snowflake server
Examples
Execute a query and fetch results on another task to update another table
tasks:
- id: select
type: io.kestra.plugin.jdbc.snowflake.Query
url: jdbc:snowflake://<account_identifier>.snowflakecomputing.com
username: snowflake
password: snowflake_passwd
sql: select * from source
fetch: true
- id: generate-update
type: io.kestra.plugin.jdbc.snowflake.Query
url: jdbc:snowflake://<account_identifier>.snowflakecomputing.com
username: snowflake
password: snowflake_passwd
sql: "{% for row in outputs.update.rows %} INSERT INTO destination (year_month, store_code, update_date) values ({{row.year_month}}, {{row.store_code}}, TO_DATE('{{row.date}}', 'MONTH DD, YYYY') ); {% endfor %}"
Properties
url
- Type: string
- Dynamic: ✔️
- Required: ✔️
The jdbc url to connect to the database
autoCommit
- Type: boolean
- Dynamic: ❌
- Required: ❌
- Default:
true
If autocommit is enabled
Sets this connection's auto-commit mode to the given state. If a connection is in auto-commit mode, then all its SQL statements will be executed and committed as individual transactions. Otherwise, its SQL statements are grouped into transactions that are terminated by a call to either the method commitor the method rollback. By default, new connections are in auto-commit mode except if you are using a store
properties that will disabled autocommit whenever this properties values.
database
- Type: string
- Dynamic: ✔️
- Required: ❌
Specifies the default database to use once connected, or specifies an empty string.
The specified database should be an existing database for which the specified default role has privileges. If you need to use a different database after connecting, execute the USE DATABASE command.
fetch
- Type: boolean
- Dynamic: ❌
- Required: ❌
- Default:
false
Whether to fetch the data from the query result to the task output This parameter is evaluated after 'fetchOne' and 'store'.
fetchOne
- Type: boolean
- Dynamic: ❌
- Required: ❌
- Default:
false
Whether to fetch only one data row from the query result to the task output. This parameter is evaluated before 'store' and 'fetch'.
fetchSize
- Type: integer
- Dynamic: ❌
- Required: ❌
- Default:
10000
Number of rows that should be fetched
Gives the JDBC driver a hint as to the number of rows that should be fetched from the database when more rows are needed for this ResultSet object. If the fetch size specified is zero, the JDBC driver ignores the value and is free to make its own best guess as to what the fetch size should be. Ignored if autoCommit
is false.
password
- Type: string
- Dynamic: ✔️
- Required: ❌
The database user's password
role
- Type: string
- Dynamic: ✔️
- Required: ❌
Specifies the default access control role to use in the Snowflake session initiated by the driver.
The specified role should be an existing role that has already been assigned to the specified user for the driver. If the specified role has not already been assigned to the user, the role is not used when the session is initiated by the driver. If you need to use a different role after connecting, execute the USE ROLE command.
schema
- Type: string
- Dynamic: ✔️
- Required: ❌
Specifies the default schema to use for the specified database once connected.
The specified schema should be an existing schema for which the specified default role has privileges. If you need to use a different schema after connecting, execute the USE SCHEMA command.
sql
- Type: string
- Dynamic: ✔️
- Required: ❌
The sql query to run
store
- Type: boolean
- Dynamic: ❌
- Required: ❌
- Default:
false
Whether to fetch data row from the query result to a file in internal storage. File will be saved as Amazon Ion (text format). See Amazon Ion documentation This parameter is evaluated after 'fetchOne' but before 'fetch'.
timeZoneId
- Type: string
- Dynamic: ❌
- Required: ❌
The time zone id to use for date/time manipulation. Default value is the worker default zone id.
username
- Type: string
- Dynamic: ✔️
- Required: ❌
The database user
warehouse
- Type: string
- Dynamic: ✔️
- Required: ❌
Specifies the virtual warehouse to use once connected.
The specified warehouse should be an existing warehouse for which the specified default role has privileges. If you need to use a different warehouse after connecting, execute the USE WAREHOUSE command can be executed to set a different warehouse for the session.
Outputs
row
- Type: object
Map containing the first row of fetched data
Only populated if 'fetchOne' parameter is set to true.
rows
- Type: array
- SubType: object
Lit of map containing rows of fetched data
Only populated if 'fetch' parameter is set to true.
size
- Type: integer
The size of the fetched rows
Only populated if 'store' or 'fetch' parameter is set to true.
uri
- Type: string
The url of the result file on kestra storage (.ion file / Amazon Ion text format)
Only populated if 'store' is set to true.