CreateDataset
Create a dataset or update if it already exists.
type: "io.kestra.plugin.gcp.bigquery.CreateDataset"Create a dataset if not exits
id: gcp_bq_create_dataset
namespace: company.team
tasks:
- id: create_dataset
type: io.kestra.plugin.gcp.bigquery.CreateDataset
name: "my_dataset"
location: "EU"
ifExists: "SKIP"
YESThe dataset's user-defined ID.
NOThe default encryption key for all tables in the dataset.
Once this property is set, all newly-created partitioned tables in the dataset will have encryption key set to this value, unless table creation request (or query) overrides the key.
YESYESYESThe dataset description.
A user-friendly description for the dataset.
YESA user-friendly name for the dataset.
YESERRORERRORUPDATESKIPPolicy to apply if a dataset already exists.
YESThe GCP service account to impersonate.
YESThe dataset's labels.
YESThe geographic location where the dataset should reside.
This property is experimental and might be subject to change or removed. See Dataset Location
YESThe GCP project ID.
NOYES["due to concurrent update","Retrying the job may solve the problem"]The messages which would trigger an automatic retry.
Message is tested as a substring of the full message, and is case insensitive.
YES["rateLimitExceeded","jobBackendError","internalError","jobInternalError"]The reasons which would trigger an automatic retry.
YES["https://www.googleapis.com/auth/cloud-platform"]The GCP scopes to be used.
YESThe GCP service account.
The dataset's user-defined ID.
A user-friendly description for the dataset.
A user-friendly name for the dataset.
The geographic location where the dataset should reside.
This property is experimental and might be subject to change or removed. See Dataset Location
The GCP project ID.
NOdurationNORETRY_FAILED_TASKRETRY_FAILED_TASKCREATE_NEW_EXECUTIONNO >= 1NOdurationNOconstantNOfalseNOdurationNOdurationNORETRY_FAILED_TASKRETRY_FAILED_TASKCREATE_NEW_EXECUTIONNO >= 1NOdurationNOrandomNOfalseYESThe value for the entity.
For example, user email if the type is USER.
NONOdurationNOdurationNORETRY_FAILED_TASKRETRY_FAILED_TASKCREATE_NEW_EXECUTIONNONO >= 1NOdurationNOexponentialNOfalseNOThe GCP entity.
YESREADERWRITEROWNERThe role to assign to the entity.