🚀 New! Kestra raises $3 million to grow Learn more

Query Query

yaml
type: "io.kestra.plugin.jdbc.postgresql.Query"

Query a PostgreSQL server.

Examples

Execute a query and fetch results in a task, and update another table with fetched results in a different task.

yaml
tasks:
- id: fetch
  type: io.kestra.plugin.jdbc.postgresql.Query
  url: jdbc:postgresql://127.0.0.1:56982/
  username: pg_user
  password: pg_passwd
  sql: select concert_id, available, a, b, c, d, play_time, library_record, floatn_test, double_test, real_test, numeric_test, date_type, time_type, timez_type, timestamp_type, timestampz_type, interval_type, pay_by_quarter, schedule, json_type, blob_type from pgsql_types
  fetch: true
- id: use-fetched-data
  type: io.kestra.plugin.jdbc.postgresql.Query
  url: jdbc:postgresql://127.0.0.1:56982/
  username: pg_user
  password: pg_passwd
  sql:  "{% for row in outputs.fetch.rows %} INSERT INTO pl_store_distribute (year_month,store_code, update_date) values ({{row.play_time}}, {{row.concert_id}}, TO_TIMESTAMP('{{row.timestamp_type}}', 'YYYY-MM-DDTHH:MI:SS.US') ); {% endfor %}"

Properties

url

  • Type: string
  • Dynamic: ✔️
  • Required: ✔️

The JDBC URL to connect to the database.

autoCommit

  • Type: boolean
  • Dynamic:
  • Required:
  • Default: true

Whether autocommit is enabled. Sets this connection's auto-commit mode to the given state. If a connection is in auto-commit mode, then all its SQL statements will be executed and committed as individual transactions. Otherwise, its SQL statements are grouped into transactions that are terminated by a call to either the method commit or the method rollback. By default, new connections are in auto-commit mode except when you are using store property in which case the auto-commit will be disabled.

fetch

  • Type: boolean
  • Dynamic:
  • Required:
  • Default: false

Whether to fetch the data from the query result to the task output. This parameter is evaluated after fetchOne and store.

fetchOne

  • Type: boolean
  • Dynamic:
  • Required:
  • Default: false

Whether to fetch only one data row from the query result to the task output. This parameter is evaluated before store and fetch.

fetchSize

  • Type: integer
  • Dynamic:
  • Required:
  • Default: 10000

Number of rows that should be fetched. Gives the JDBC driver a hint as to the number of rows that should be fetched from the database when more rows are needed for this ResultSet object. If the fetch size specified is zero, the JDBC driver ignores the value and is free to make its own best guess as to what the fetch size should be. Ignored if autoCommit is false.

password

  • Type: string
  • Dynamic: ✔️
  • Required:

The database user's password.

sql

  • Type: string
  • Dynamic: ✔️
  • Required:

The SQL query to run.

ssl

  • Type: boolean
  • Dynamic:
  • Required:
  • Default: false

Is the connection SSL?

sslCert

  • Type: string
  • Dynamic: ✔️
  • Required:

The SSL cert. Must be a PEM encoded certificate

sslKey

  • Type: string
  • Dynamic: ✔️
  • Required:

The SSL key. Must be a PEM encoded key

sslKeyPassword

  • Type: string
  • Dynamic: ✔️
  • Required:

The SSL key password.

sslMode

  • Type: string
  • Dynamic:
  • Required:
  • Possible Values:
    • DISABLE
    • ALLOW
    • PREFER
    • REQUIRE
    • VERIFY_CA
    • VERIFY_FULL

The SSL mode.

sslRootCert

  • Type: string
  • Dynamic: ✔️
  • Required:

The SSL root cert. Must be a PEM encoded certificate

store

  • Type: boolean
  • Dynamic:
  • Required:
  • Default: false

Whether to fetch data row(s) from the query result to a file in internal storage. File will be saved as Amazon Ion (text format). See Amazon Ion documentation This parameter is evaluated after fetchOne but before fetch.

timeZoneId

  • Type: string
  • Dynamic:
  • Required:

The time zone id to use for date/time manipulation. Default value is the worker's default time zone id.

username

  • Type: string
  • Dynamic: ✔️
  • Required:

The database user.

Outputs

row

  • Type: object
  • Dynamic:
  • Required:

Map containing the first row of fetched data. Only populated if fetchOne parameter is set to true.

rows

  • Type: array
  • SubType: object
  • Dynamic:
  • Required:

List of map containing rows of fetched data. Only populated if fetch parameter is set to true.

size

  • Type: integer
  • Dynamic:
  • Required:

The number of rows fetched. Only populated if store or fetch parameter is set to true.

uri

  • Type: string
  • Dynamic:
  • Required:
  • Format: uri

The URI of the result file on Kestra's internal storage (.ion file / Amazon Ion formatted text file). Only populated if store is set to true.