Google Cloud DeletePartitions

Google Cloud DeletePartitions

Certified

Delete BigQuery partitions in a range

Lists partitions in the given date or range interval and deletes them. Fails if any targeted partition is missing.

yaml
type: io.kestra.plugin.gcp.bigquery.DeletePartitions
yaml
id: gcp_bq_delete_partitions
namespace: company.team

tasks:
  - id: delete_partitions
    type: io.kestra.plugin.gcp.bigquery.DeletePartitions
    projectId: my-project
    dataset: my-dataset
    table: my-table
    partitionType: DAY
    from: "{{ now() | dateAdd(-30, 'DAYS') }}"
    to: "{{ now() | dateAdd(-7, 'DAYS') }}"
Properties

Dataset ID

Target dataset name

Partition start

Inclusive start value. Use an integer for RANGE partitions or an ISO datetime for date/time partitions.

Possible Values
DAYHOURMONTHYEARRANGE

Partition type

DAY, HOUR, MONTH, YEAR, or RANGE

Table ID

Target table name

Partition end

Inclusive end value. Use an integer for RANGE partitions or an ISO datetime for date/time partitions.

The GCP service account to impersonate

Dataset location

Optional BigQuery location for created or targeted resources. Experimental and may change; see BigQuery dataset location documentation.

Reference (ref) of the pluginDefaults to apply to this task.

The GCP project ID

Automatic BigQuery retry policy

Optional custom retry policy for retryable BigQuery errors. If unset, uses an exponential backoff starting at 5s (per-attempt interval capped at 60m), with a total duration of up to 15m and a maximum of 10 attempts.

Definitions

Retry with a fixed delay between attempts.

interval*Requiredstring
Formatduration
type*Requiredobject
behaviorstring
DefaultRETRY_FAILED_TASK
Possible Values
RETRY_FAILED_TASKCREATE_NEW_EXECUTION
maxAttemptsinteger
Minimum>= 1
maxDurationstring
Formatduration
warningOnRetryboolean
Defaultfalse

Retry with exponentially increasing delays between attempts.

interval*Requiredstring
Formatduration
maxInterval*Requiredstring
Formatduration
type*Requiredobject
behaviorstring
DefaultRETRY_FAILED_TASK
Possible Values
RETRY_FAILED_TASKCREATE_NEW_EXECUTION
delayFactornumber
maxAttemptsinteger
Minimum>= 1
maxDurationstring
Formatduration
warningOnRetryboolean
Defaultfalse

Retry with a random delay within a configurable range between attempts.

maxInterval*Requiredstring
Formatduration
minInterval*Requiredstring
Formatduration
type*Requiredobject
behaviorstring
DefaultRETRY_FAILED_TASK
Possible Values
RETRY_FAILED_TASKCREATE_NEW_EXECUTION
maxAttemptsinteger
Minimum>= 1
maxDurationstring
Formatduration
warningOnRetryboolean
Defaultfalse
SubTypestring
Default["due to concurrent update","Retrying the job may solve the problem","Retrying may solve the problem"]

Retry message substrings

Case-insensitive substrings that, if found in the error message, trigger an automatic retry

SubTypestring
Default["rateLimitExceeded","jobBackendError","backendError","internalError","jobInternalError"]

Retry reasons

BigQuery error reasons that trigger an automatic retry; evaluated against error reason strings

SubTypestring
Default["https://www.googleapis.com/auth/cloud-platform"]

The GCP scopes to be used

The GCP service account

Dataset ID

SubTypestring

Partitions deleted

Project ID

Table name

The number of partitions deleted.