Wait for query on BigQuery.

Wait for a sql query to return results and iterate through rows.

yaml
id: bigquery_listen
namespace: company.team

tasks:
  - id: each
    type: io.kestra.plugin.core.flow.ForEach
    values: "{{ trigger.rows }}"
    tasks:
      - id: return
        type: io.kestra.plugin.core.debug.Return
        format: "{{ taskrun.value }}"

triggers:
  - id: watch
    type: io.kestra.plugin.gcp.bigquery.Trigger
    interval: "PT5M"
    sql: "SELECT * FROM `myproject.mydataset.mytable`"
    fetch: true

SubType

Dynamic NO

List of conditions in order to limit the flow trigger.

Dynamic NO

Default false

Whether to Fetch the data from the query result to the task output. This is deprecated, use fetchType: FETCH instead

Dynamic NO

Default false

Whether to Fetch only one data row from the query result to the task output. This is deprecated, use fetchType: FETCH_ONE instead

Dynamic YES

Default NONE

Possible Values

STOREFETCHFETCH_ONENONE

Fetch type

The way you want to store data :

FETCH_ONE - output the first row
FETCH - output all rows as output variable
STORE - store all rows to a file
NONE - do nothing

Dynamic NO

Default 60

Format duration

Interval between polling.

The interval between 2 different polls of schedule, this can avoid to overload the remote system with too many calls. For most of the triggers that depend on external systems, a minimal interval must be at least PT30S. See ISO_8601 Durations for more information of available interval values.

Dynamic YES

Default false

Dynamic YES

SubType string

Dynamic YES

Default ["https://www.googleapis.com/auth/cloud-platform"]

Dynamic YES

The sql query to run

SubType string

Dynamic NO

Possible Values

CREATEDRUNNINGPAUSEDRESTARTEDKILLINGSUCCESSWARNINGFAILEDKILLEDCANCELLEDQUEUEDRETRYINGRETRIEDSKIPPED

List of execution states after which a trigger should be stopped (a.k.a. disabled).

Dynamic NO

Default false

Whether to store the data from the query result into an ion serialized data file. This is deprecated, use fetchType: STORE instead

The destination table (if one) or the temporary table created automatically

The job id

Map containing the first row of fetched data

Only populated if 'fetchOne' parameter is set to true.

SubType object

List containing the fetched data

Only populated if 'fetch' parameter is set to true.

The size of the rows fetch

Format uri

The uri of store result

Only populated if 'store' is set to true.

Dynamic NO

The dataset of the table

Dynamic NO

The project of the table

Dynamic NO

The table name

​Trigger

Trigger