BulkInsert
type: "io.kestra.plugin.jdbc.clickhouse.BulkInsert"Bulk Insert new rows into a ClickHouse database.
Examples
Insert rows from another table to a Clickhouse database using asynchronous inserts
id: "bulk_insert"
type: "io.kestra.plugin.jdbc.clickhouse.BulkInsert"
from: "{{ outputs.query.uri }}"
url: jdbc:clickhouse://127.0.0.1:56982/
username: clickhouse
password: ch_passwd
sql: INSERT INTO YourTable SETTINGS async_insert=1, wait_for_async_insert=1 values( ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ? )Insert data into specific columns via a SQL query to a ClickHouse database using asynchronous inserts
id: "bulk_insert"
type: "io.kestra.plugin.jdbc.clickhouse.BulkInsert"
from: "{{ outputs.query.uri }}"
url: jdbc:clickhouse://127.0.0.1:56982/
username: clickhouse
password: ch_passwd
sql: INSERT INTO YourTable ( field1, field2, field3 ) SETTINGS async_insert=1, wait_for_async_insert=1 values( ?, ?, ? )Properties
chunk
- Type: integer
- Dynamic: ✔️
- Required: ✔️
- Default:
1000
The size of chunk for every bulk request
from
- Type: string
- Dynamic: ✔️
- Required: ✔️
Source file URI
sql
- Type: string
- Dynamic: ✔️
- Required: ✔️
Insert query to be executed
The query must have as much question mark as column in the files. Example: 'insert into database values( ? , ? , ? )' for 3 columns In case you do not want all columns, you need to precise it in the query and in the columns property Example: 'insert into(id,name) database values( ? , ? )' to select 2 columns
url
- Type: string
- Dynamic: ✔️
- Required: ✔️
The JDBC URL to connect to the database
columns
- Type: array
- SubType: string
- Dynamic: ✔️
- Required: ❌
The columns to be insert
If not provided, ? count need to match the from number of cols
password
- Type: string
- Dynamic: ✔️
- Required: ❌
The database user's password
timeZoneId
- Type: string
- Dynamic: ❌
- Required: ❌
The time zone id to use for date/time manipulation. Default value is the worker default zone id.
username
- Type: string
- Dynamic: ✔️
- Required: ❌
The database user
Outputs
rowCount
- Type: integer
The rows count
updatedCount
- Type: integer
The updated rows count