BulkInsert

yaml

type: "io.kestra.plugin.jdbc.clickhouse.BulkInsert"

Bulk Insert new rows into a ClickHouse database.

Examples

Insert rows from another table to a Clickhouse database using asynchronous inserts.

yaml

id: "bulk_insert"
type: "io.kestra.plugin.jdbc.clickhouse.BulkInsert"
from: "{{ outputs.query.uri }}"
url: jdbc:clickhouse://127.0.0.1:56982/
username: ch_user
password: ch_passwd
sql: INSERT INTO YourTable SETTINGS async_insert=1, wait_for_async_insert=1 values( ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ? )

Insert data into specific columns via a SQL query to a ClickHouse database using asynchronous inserts.

yaml

id: "bulk_insert"
type: "io.kestra.plugin.jdbc.clickhouse.BulkInsert"
from: "{{ outputs.query.uri }}"
url: jdbc:clickhouse://127.0.0.1:56982/
username: ch_user
password: ch_passwd
sql: INSERT INTO YourTable ( field1, field2, field3 ) SETTINGS async_insert=1, wait_for_async_insert=1 values( ?, ?, ? )

Properties

`chunk`

Type: integer
Dynamic: ✔️
Required: ✔️
Default: 1000

The size of chunk for every bulk request.

`from`

Type: string
Dynamic: ✔️
Required: ✔️

Source file URI

`sql`

Type: string
Dynamic: ✔️
Required: ✔️

Insert query to be executed.

The query must have as many question marks as the number of columns in the table. Example: 'insert into <table_name> values( ? , ? , ? )' for 3 columns. In case you do not want all columns, you need to specify it in the query in the columns property Example: 'insert into <table_name> (id, name) values( ? , ? )' for inserting data into 2 columns: 'id' and 'name'.