UpdateTable
Update table metadata
type: "io.kestra.plugin.gcp.bigquery.UpdateTable"
id: gcp_bq_update_table
namespace: company.team
tasks:
- id: update_table
type: io.kestra.plugin.gcp.bigquery.UpdateTable
projectId: my-project
dataset: my-dataset
table: my-table
expirationDuration: PT48H
YES
The dataset's user-defined ID.
YES
The table's user-defined ID.
YES
The user-friendly description for the table.
NO
The encryption configuration.
YES
duration
Sets the duration, since now, when this table expires.
If not present, the table will persist indefinitely. Expired tables will be deleted and their storage reclaimed.
YES
The user-friendly name for the table.
YES
The GCP service account to impersonate.
YES
Return a map for labels applied to the table.
YES
The geographic location where the dataset should reside.
This property is experimental and might be subject to change or removed.
See Dataset Location
YES
The GCP project ID.
YES
NO
YES
["due to concurrent update","Retrying the job may solve the problem"]
The messages which would trigger an automatic retry.
Message is tested as a substring of the full message, and is case insensitive.
YES
["rateLimitExceeded","jobBackendError","internalError","jobInternalError"]
The reasons which would trigger an automatic retry.
YES
["https://www.googleapis.com/auth/cloud-platform"]
The GCP scopes to be used.
YES
The GCP service account.
NO
The table definition.
date-time
The time when this table was created.
The dataset's ID.
The table definition.
The user-friendly description for the table.
The encryption configuration.
The hash of the table resource.
date-time
Returns the time when this table expires.
If not present, the table will persist indefinitely. Expired tables will be deleted and their storage reclaimed.
The user-friendly name for the table.
The service-generated id for the table.
Return a map for labels applied to the table.
date-time
The time when this table was last modified.
The size of this table in bytes.
The number of bytes considered "long-term storage" for reduced billing purposes.
The number of rows of data in this table.
The project's ID.
Return true if a partition filter (that can be used for partition elimination) is required for queries over this table.
The URL that can be used to access the resource again. The returned URL can be used for get or update requests.
The table name.
NO
duration
NO
RETRY_FAILED_TASK
RETRY_FAILED_TASK
CREATE_NEW_EXECUTION
NO
>= 1
NO
duration
NO
constant
NO
false
NO
The external table definition if the type is EXTERNAL
.
NO
The materialized view definition if the type is MATERIALIZED_VIEW
.
NO
The table's schema.
NO
The table definition if the type is TABLE
.
NO
The view definition if the type is VIEW
.
NO
YES
Returns the clustering configuration for this table. If {@code null}, the table is not clustered.
NO
Returns the range partitioning configuration for this table. If {@code null}, the table is not range-partitioned.
NO
Returns information on the table's streaming buffer, if exists. Returns {@code null} if no streaming buffer exists.
NO
Returns the time partitioning configuration for this table. If {@code null}, the table is not time-partitioned.
NO
duration
NO
duration
NO
RETRY_FAILED_TASK
RETRY_FAILED_TASK
CREATE_NEW_EXECUTION
NO
NO
>= 1
NO
duration
NO
exponential
NO
false
NO
NO
NO
YES
YES
YES
NO
duration
NO
duration
NO
RETRY_FAILED_TASK
RETRY_FAILED_TASK
CREATE_NEW_EXECUTION
NO
>= 1
NO
duration
NO
random
NO
false
NO
NO
NO
NO
NO
TABLE
VIEW
MATERIALIZED_VIEW
EXTERNAL
MODEL
NO
NO
YES
NO
NO
date-time
NO
NO
duration
NO
NO
YES
NO
YES
NO
date-time
Date when this materialized view was last modified.
YES
The query whose result is persisted.
YES
duration
The maximum frequency at which this materialized view will be refreshed.
YES
duration
The number of milliseconds for which to keep the storage for a partition. When expired, the storage for the partition is reclaimed. If null, the partition does not expire.
YES
If not set, the table is partitioned by pseudo column '_PARTITIONTIME'; if set, the table is partitioned by this field.
YES
YES
The field description.
YES
NULLABLE
REQUIRED
REPEATED
The field mode.
By default, Field.Mode.NULLABLE
is used.
YES
The field name.
NO
The policy tags for the field.
YES
INLINE
FROM_URI
YES
If type
is UserDefinedFunction.Type.INLINE, this method returns a code blob.
If type
is UserDefinedFunction.Type.FROM_URI, the method returns a Google Cloud Storage URI (e.g. gs://bucket/path).
YES
YES
The compression type of the data source.
YES
CSV
JSON
BIGTABLE
DATASTORE_BACKUP
AVRO
GOOGLE_SHEETS
PARQUET
ORC
The source format, and possibly some parsing options, of the external data.
YES
YES
YES
The fully-qualified URIs that point to your data in Google Cloud Storage.
Each URI can
- contain one '*' wildcard character that must come after the bucket's name. Size limits related
- to load jobs apply to external data sources, plus an additional limit of 10 GB maximum size
- across all URIs.
NO
NO
NO
NO
duration
NO
NO
NO
DAY
HOUR
MONTH
YEAR
NO
NO
INLINE
FROM_URI
NO
NO
NO
CSV
JSON
BIGTABLE
DATASTORE_BACKUP
AVRO
GOOGLE_SHEETS
PARQUET
ORC
NO
NO
NO
NO
NO
NO
NO