Batch Batch

yaml
type: "io.kestra.plugin.jdbc.postgresql.Batch"

Execute a batch query to a PostgreSQL server.

Examples

Fetch rows from a table, and bulk insert them to another one.

yaml
tasks:
  - id: query
    type: io.kestra.plugin.jdbc.postgresql.Query
    url: jdbc:postgresql://dev:56982/
    username: pg_user
    password: pg_passwd
    sql: |
      SELECT *
      FROM xref
      LIMIT 1500;
    store: true
  - id: update
    type: io.kestra.plugin.jdbc.postgresql.Batch
    from: "{{ outputs.query.uri }}"
    url: jdbc:postgresql://prod:56982/
    username: pg_user
    password: pg_passwd
    sql: |
      insert into xref values( ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ? )

Properties

chunk

  • Type: integer
  • Dynamic: βœ”οΈ
  • Required: βœ”οΈ
  • Default: 1000

The size of chunk for every bulk request.

from

  • Type: string
  • Dynamic: βœ”οΈ
  • Required: βœ”οΈ

Source file URI

sql

  • Type: string
  • Dynamic: βœ”οΈ
  • Required: βœ”οΈ

Insert query to be executed.

The query must have as many question marks as the number of columns in the table. Example: 'insert into <table_name> values( ? , ? , ? )' for 3 columns. In case you do not want all columns, you need to specify it in the query in the columns property Example: 'insert into <table_name> (id, name) values( ? , ? )' for inserting data into 2 columns: 'id' and 'name'.

url

  • Type: string
  • Dynamic: βœ”οΈ
  • Required: βœ”οΈ

The JDBC URL to connect to the database.

columns

  • Type: array
  • SubType: string
  • Dynamic: βœ”οΈ
  • Required: ❌

The columns to be inserted.

If not provided, ? count need to match the from number of columns.

password

  • Type: string
  • Dynamic: βœ”οΈ
  • Required: ❌

The database user's password.

ssl

  • Type: boolean
  • Dynamic: ❌
  • Required: ❌
  • Default: false

Is the connection SSL?

sslCert

  • Type: string
  • Dynamic: βœ”οΈ
  • Required: ❌

The SSL cert.

Must be a PEM encoded certificate

sslKey

  • Type: string
  • Dynamic: βœ”οΈ
  • Required: ❌

The SSL key.

Must be a PEM encoded key

sslKeyPassword

  • Type: string
  • Dynamic: βœ”οΈ
  • Required: ❌

The SSL key password.

sslMode

  • Type: string
  • Dynamic: ❌
  • Required: ❌
  • Possible Values:
    • DISABLE
    • ALLOW
    • PREFER
    • REQUIRE
    • VERIFY_CA
    • VERIFY_FULL

The SSL mode.

sslRootCert

  • Type: string
  • Dynamic: βœ”οΈ
  • Required: ❌

The SSL root cert.

Must be a PEM encoded certificate

timeZoneId

  • Type: string
  • Dynamic: ❌
  • Required: ❌

The time zone id to use for date/time manipulation. Default value is the worker's default time zone id.

username

  • Type: string
  • Dynamic: βœ”οΈ
  • Required: ❌

The database user.

Outputs

rowCount

  • Type: integer
  • Dynamic: ❓
  • Required: ❌

The rows count.

updatedCount

  • Type: integer
  • Dynamic: ❓
  • Required: ❌

The updated rows count.

Was this page helpful?