DeletePartitions
type: "io.kestra.plugin.gcp.bigquery.DeletePartitions"
Delete partitions between interval
# Examples
id: "delete_partitions"
type: "io.kestra.plugin.gcp.bigquery.DeletePartitions"
projectId: my-project
dataset: my-dataset
table: my-table
partitionType: DAY
from: "{{ now() | dateAdd(-30, 'DAYS') }}"
to: "{{ now() | dateAdd(-7, 'DAYS') }}"
# Properties
# dataset
- Type: string
- Dynamic: ✔️
- Required: ✔️
The dataset's user-defined id
# from
- Type: string
- Dynamic: ✔️
- Required: ✔️
The inclusive starting date or integer
If the partition :- is a numeric range, must be a valid integer
- is a date, must a valid datetime like
{{ now() }}
# location
- Type: string
- Dynamic: ✔️
- Required: ❌
The geographic location where the dataset should reside
This property is experimental and might be subject to change or removed.
See Dataset Location
# partitionType
Type: string
Dynamic: ✔️
Required: ✔️
Possible Values:
DAY
HOUR
MONTH
YEAR
RANGE
The partition type of the table
# projectId
- Type: string
- Dynamic: ✔️
- Required: ❌
The GCP project id
# retryAuto
- Type:
Constant
Exponential
Random - Dynamic: ❓
- Required: ❌
# retryMessages
- Type: array
- SubType: string
- Dynamic: ✔️
- Required: ❌
- Default:
[due to concurrent update, Retrying the job may solve the problem]
The message that are valid for a automatic retry.
Message is tested as a substring of the full message and case insensitive
# retryReasons
- Type: array
- SubType: string
- Dynamic: ✔️
- Required: ❌
- Default:
[rateLimitExceeded, jobBackendError, internalError, jobInternalError]
The reason that are valid for a automatic retry.
# scopes
- Type: array
- SubType: string
- Dynamic: ✔️
- Required: ❌
- Default:
[https://www.googleapis.com/auth/cloud-platform]
The GCP scopes to used
# serviceAccount
- Type: string
- Dynamic: ✔️
- Required: ❌
The GCP service account key
# table
- Type: string
- Dynamic: ✔️
- Required: ✔️
The table user-defined id
# to
- Type: string
- Dynamic: ✔️
- Required: ✔️
The inclusive ending date or integer
If the partition :- is a numeric range, must be a valid integer
- is a date, must a valid datetime like
{{ now() }}
# Outputs
# datasetId
- Type: string
The dataset's id
# partitions
- Type: array
- SubType: string
Partitions deleted
# projectId
- Type: string
The project's id
# table
- Type: string
The table name
# Definitions
# Constant
# interval
- Type: string
- Dynamic: ❓
- Required: ✔️
- Format:
duration
# maxAttempt
- Type: integer
- Dynamic: ❓
- Required: ❌
- Minimum:
>= 1
# maxDuration
- Type: string
- Dynamic: ❓
- Required: ❌
- Format:
duration
# warningOnRetry
- Type: boolean
- Dynamic: ❓
- Required: ❌
- Default:
false
# Random
# maxAttempt
- Type: integer
- Dynamic: ❓
- Required: ❌
- Minimum:
>= 1
# maxDuration
- Type: string
- Dynamic: ❓
- Required: ❌
- Format:
duration
# maxInterval
- Type: string
- Dynamic: ❓
- Required: ✔️
- Format:
duration
# minInterval
- Type: string
- Dynamic: ❓
- Required: ✔️
- Format:
duration
# warningOnRetry
- Type: boolean
- Dynamic: ❓
- Required: ❌
- Default:
false
# Exponential
# delayFactor
- Type: number
- Dynamic: ❓
- Required: ❌
# interval
- Type: string
- Dynamic: ❓
- Required: ✔️
- Format:
duration
# maxAttempt
- Type: integer
- Dynamic: ❓
- Required: ❌
- Minimum:
>= 1
# maxDuration
- Type: string
- Dynamic: ❓
- Required: ❌
- Format:
duration
# maxInterval
- Type: string
- Dynamic: ❓
- Required: ✔️
- Format:
duration
# warningOnRetry
- Type: boolean
- Dynamic: ❓
- Required: ❌
- Default:
false