Execute a batch query to a PostgreSQL server.
type: "io.kestra.plugin.jdbc.postgresql.Batch"
Fetch rows from a table, and bulk insert them to another one.
id: postgres_bulk_insert
namespace: company.team
tasks:
- id: query
type: io.kestra.plugin.jdbc.postgresql.Query
url: jdbc:postgresql://dev:56982/
username: pg_user
password: pg_password
sql: |
SELECT *
FROM xref
LIMIT 1500;
fetchType: STORE
- id: update
type: io.kestra.plugin.jdbc.postgresql.Batch
from: "{{ outputs.query.uri }}"
url: jdbc:postgresql://prod:56982/
username: pg_user
password: pg_password
sql: |
insert into xref values( ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ? )
Fetch rows from a table, and bulk insert them to another one, without using sql query.
id: postgres_bulk_insert
namespace: company.team
tasks:
- id: query
type: io.kestra.plugin.jdbc.postgresql.Query
url: jdbc:postgresql://dev:56982/
username: pg_user
password: pg_password
sql: |
SELECT *
FROM xref
LIMIT 1500;
fetchType: STORE
- id: update
type: io.kestra.plugin.jdbc.postgresql.Batch
from: "{{ outputs.query.uri }}"
url: jdbc:postgresql://prod:56982/
username: pg_user
password: pg_password
table: xre
YES
Source file URI
YES
Insert query to be executed.
The query must have as many question marks as the number of columns in the table. Example: 'insert into <table_name> values( ? , ? , ? )' for 3 columns. In case you do not want all columns, you need to specify it in the query in the columns property Example: 'insert into <table_name> (id, name) values( ? , ? )' for inserting data into 2 columns: 'id' and 'name'.
YES
The JDBC URL to connect to the database.
YES
1000
YES
The columns to be inserted.
If not provided, ?
count need to match the from
number of columns.
YES
The database user's password.
YES
false
YES
The SSL cert.
Must be a PEM encoded certificate
YES
The SSL key.
Must be a PEM encoded key
YES
The SSL key password.
YES
DISABLE
ALLOW
PREFER
REQUIRE
VERIFY_CA
VERIFY_FULL
The SSL mode.
YES
The SSL root cert.
Must be a PEM encoded certificate
YES
The table from which column names will be retrieved.
This property specifies the table name which will be used to retrieve the columns for the inserted values.
You can use it instead of specifying manually the columns in the columns
property. In this case, the sql
property can also be omitted, an INSERT statement would be generated automatically.
YES
The time zone id to use for date/time manipulation. Default value is the worker's default time zone id.
YES
The database user.
The rows count.
The updated rows count.