Batch | Kestra

Batch

Bulk insert rows into Vertica using prepared statements

yaml
type: io.kestra.plugin.jdbc.vertica.Batch

Examples

yaml
id: vertica_batch_query
namespace: company.team

tasks:
  - id: query
    type: io.kestra.plugin.jdbc.vertica.Query
    url: jdbc:vertica://dev:56982/db
    username: "{{ secret('VERTICA_USERNAME') }}"
    password: "{{ secret('VERTICA_PASSWORD') }}"
    sql: |
      SELECT *
      FROM xref
      LIMIT 1500;
    fetchType: STORE

  - id: update
    type: io.kestra.plugin.jdbc.vertica.Batch
    from: "{{ outputs.query.uri }}"
    url: jdbc:vertica://prod:56982/db
    username: "{{ secret('VERTICA_USERNAME') }}"
    password: "{{ secret('VERTICA_PASSWORD') }}"
    sql: insert into xref values( ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ? )

yaml
    id: vertica_batch_query
    namespace: company.team

    tasks:
      - id: query
        type: io.kestra.plugin.jdbc.vertica.Query
        url: jdbc:vertica://dev:56982/db
        username: vertica_user
        password: vertica_passwd
        sql: |
          SELECT *
          FROM xref
          LIMIT 1500;
        fetchType: STORE

      - id: update
        type: io.kestra.plugin.jdbc.vertica.Batch
        from: "{{ outputs.query.uri }}"
        url: jdbc:vertica://prod:56982/db
        username: vertica_user
        password: vertica_passwd
        table: xref

Properties

from *string

url *string

chunk integerstring

Default1000

columns array

SubTypestring

inputHandling string

DefaultAUTO

Possible Values

AUTOSTREAMLOCAL

localBufferMaxBytes integerstring

Default104857600

maxRetries integerstring

Default3

password string

resumeOnRetry booleanstring

Defaulttrue

retryBackoff string

DefaultPT1S

retryScope string

DefaultINPUT

Possible Values

NONEINPUTALL

sql string

table string

timeZoneId string

username string

Outputs

rowCount integer

updatedCount integer

Metrics

query counter

Unitqueries

records counter

Unitrecords

updated counter

Unitrecords

MongoDB

Tasks that query and manipulate MongoDB collections.

Data

Weaviate

Tasks that manage and query vectors in Weaviate.

DataAI

Hightouch

Tasks that trigger and monitor Hightouch syncs.

DataBusiness

Batch

Bulk insert rows into Vertica using prepared statements

More Plugins in this Category

MongoDB

Weaviate

Hightouch

1.9.1

Batch Bulk insert rows into Vertica using prepared statements

More Plugins in this Category

MongoDB

Weaviate

Hightouch

1.9.1

Batch

Bulk insert rows into Vertica using prepared statements