Trigger

type: "io.kestra.plugin.jdbc.pinot.Trigger"

Wait for query on a Clickhouse database.

Examples

Wait for a sql query to return results and iterate through rows

id: jdbc-trigger
namespace: io.kestra.tests

tasks:
  - id: each
    type: io.kestra.core.tasks.flows.EachSequential
    tasks:
      - id: return
        type: io.kestra.core.tasks.debugs.Return
        format: "{{json(taskrun.value)}}"
    value: "{{ trigger.rows }}"

triggers:
  - id: watch
    type: io.kestra.plugin.jdbc.pinot.Trigger
    interval: "PT5M"
    sql: "SELECT * FROM my_table"

Properties

url

• Type: string
• Dynamic: ✔️
• Required: ✔️

The JDBC URL to connect to the database

conditions

• Type: array
• SubType: Condition
• Dynamic: ❌
• Required: ❌

List of Conditions in order to limit the flow trigger.

fetch

• Type: boolean
• Dynamic: ❌
• Required: ❌
• Default: false

Whether to fetch the data from the query result to the task output This parameter is evaluated after 'fetchOne' and 'store'.

fetchOne

• Type: boolean
• Dynamic: ❌
• Required: ❌
• Default: false

Whether to fetch only one data row from the query result to the task output. This parameter is evaluated before 'store' and 'fetch'.

fetchSize

• Type: integer
• Dynamic: ❌
• Required: ❌
• Default: 10000

Number of rows that should be fetched

Gives the JDBC driver a hint as to the number of rows that should be fetched from the database when more rows are needed for this ResultSet object. If the fetch size specified is zero, the JDBC driver ignores the value and is free to make its own best guess as to what the fetch size should be. Ignored if autoCommit is false.

interval

• Type: string
• Dynamic: ❌
• Required: ❌
• Default: 60.000000000
• Format: duration

Interval between polling

The interval between 2 different test of schedule, this can avoid to overload the remote system with too many call. For most of trigger that depend on external system, a minimal interval must be at least PT30S. See ISO_8601 Durations for more information of available interval value

password

• Type: string
• Dynamic: ✔️
• Required: ❌

The database user's password

sql

• Type: string
• Dynamic: ✔️
• Required: ❌

The sql query to run

store

• Type: boolean
• Dynamic: ❌
• Required: ❌
• Default: false

Whether to fetch data row from the query result to a file in internal storage. File will be saved as Amazon Ion (text format). See Amazon Ion documentation This parameter is evaluated after 'fetchOne' but before 'fetch'.

timeZoneId

• Type: string
• Dynamic: ❌
• Required: ❌

The time zone id to use for date/time manipulation. Default value is the worker default zone id.

username

• Type: string
• Dynamic: ✔️
• Required: ❌

The database user

Outputs

row

• Type: object

Map containing the first row of fetched data

Only populated if 'fetchOne' parameter is set to true.

rows

• Type: array
• SubType: object

Lit of map containing rows of fetched data

Only populated if 'fetch' parameter is set to true.

size

• Type: integer

The size of the fetched rows

Only populated if 'store' or 'fetch' parameter is set to true.

uri

• Type: string

The url of the result file on kestra storage (.ion file / Amazon Ion text format)

Only populated if 'store' is set to true.

Definitions