Wait for query on BigQuery.

Wait for a sql query to return results and iterate through rows.

yaml
id: bigquery_listen
namespace: company.team

tasks:
  - id: each
    type: io.kestra.plugin.core.flow.ForEach
    values: "{{ trigger.rows }}"
    tasks:
      - id: return
        type: io.kestra.plugin.core.debug.Return
        format: "{{ taskrun.value }}"

triggers:
  - id: watch
    type: io.kestra.plugin.gcp.bigquery.Trigger
    interval: "PT5M"
    sql: "SELECT * FROM `myproject.mydataset.mytable`"
    fetch: true

SubType

List of conditions in order to limit the flow trigger.

Default false

Whether to Fetch the data from the query result to the task output. This is deprecated, use fetchType: FETCH instead

Default false

Whether to Fetch only one data row from the query result to the task output. This is deprecated, use fetchType: FETCH_ONE instead

Default NONE

Possible Values

STOREFETCHFETCH_ONENONE

Fetch type

The way you want to store data :

FETCH_ONE - output the first row
FETCH - output all rows as output variable
STORE - store all rows to a file
NONE - do nothing

Default 60

Format duration

Interval between polling.

The interval between 2 different polls of schedule, this can avoid to overload the remote system with too many calls. For most of the triggers that depend on external systems, a minimal interval must be at least PT30S. See ISO_8601 Durations for more information of available interval values.

Default false

Whether to use BigQuery's legacy SQL dialect for this query

By default this property is set to false.

SubType string

Default ["https://www.googleapis.com/auth/cloud-platform"]

The sql query to run

SubType string

Possible Values

CREATEDRUNNINGPAUSEDRESTARTEDKILLINGSUCCESSWARNINGFAILEDKILLEDCANCELLEDQUEUEDRETRYINGRETRIEDSKIPPED

List of execution states after which a trigger should be stopped (a.k.a. disabled).

Default false

Whether to store the data from the query result into an ion serialized data file. This is deprecated, use fetchType: STORE instead

The destination table (if one) or the temporary table created automatically

The job id

Map containing the first row of fetched data

Only populated if 'fetchOne' parameter is set to true.

SubType object

List containing the fetched data

Only populated if 'fetch' parameter is set to true.

The size of the rows fetch

Format uri

The uri of store result

Only populated if 'store' is set to true.

The dataset of the table

The project of the table

The table name