DeletePartitions DeletePartitions

type: "io.kestra.plugin.gcp.bigquery.DeletePartitions"

Delete partitions between interval

# Examples

id: "delete_partitions"
type: "io.kestra.plugin.gcp.bigquery.DeletePartitions"
projectId: my-project
dataset: my-dataset
table: my-table
partitionType: DAY
from: "{{ now() | dateAdd(-30, 'DAYS') }}"
to: "{{ now() | dateAdd(-7, 'DAYS') }}"

# Properties

# dataset

  • Type: string
  • Dynamic: ✔️
  • Required: ✔️

The dataset's user-defined id

# from

  • Type: string
  • Dynamic: ✔️
  • Required: ✔️

The inclusive starting date or integer

If the partition :- is a numeric range, must be a valid integer

  • is a date, must a valid datetime like {{ now() }}

# location

  • Type: string
  • Dynamic: ✔️
  • Required:

The geographic location where the dataset should reside

This property is experimental and might be subject to change or removed.

See Dataset Location

# partitionType

  • Type: string

  • Dynamic: ✔️

  • Required: ✔️

  • Possible Values:

    • DAY
    • HOUR
    • MONTH
    • YEAR
    • RANGE

The partition type of the table

# projectId

  • Type: string
  • Dynamic: ✔️
  • Required:

The GCP project id

# retryAuto

# retryMessages

  • Type: array
  • SubType: string
  • Dynamic: ✔️
  • Required:
  • Default: [due to concurrent update, Retrying the job may solve the problem]

The message that are valid for a automatic retry.

Message is tested as a substring of the full message and case insensitive

# retryReasons

  • Type: array
  • SubType: string
  • Dynamic: ✔️
  • Required:
  • Default: [rateLimitExceeded, jobBackendError, internalError, jobInternalError]

The reason that are valid for a automatic retry.

# scopes

  • Type: array
  • SubType: string
  • Dynamic: ✔️
  • Required:
  • Default: [https://www.googleapis.com/auth/cloud-platform]

The GCP scopes to used

# serviceAccount

  • Type: string
  • Dynamic: ✔️
  • Required:

The GCP service account key

# table

  • Type: string
  • Dynamic: ✔️
  • Required: ✔️

The table user-defined id

# to

  • Type: string
  • Dynamic: ✔️
  • Required: ✔️

The inclusive ending date or integer

If the partition :- is a numeric range, must be a valid integer

  • is a date, must a valid datetime like {{ now() }}

# Outputs

# datasetId

  • Type: string

The dataset's id

# partitions

  • Type: array
  • SubType: string

Partitions deleted

# projectId

  • Type: string

The project's id

# table

  • Type: string

The table name

# Definitions

# Constant

# interval

  • Type: string
  • Dynamic:
  • Required: ✔️
  • Format: duration

# maxAttempt

  • Type: integer
  • Dynamic:
  • Required:
  • Minimum: >= 1

# maxDuration

  • Type: string
  • Dynamic:
  • Required:
  • Format: duration

# warningOnRetry

  • Type: boolean
  • Dynamic:
  • Required:
  • Default: false

# Random

# maxAttempt

  • Type: integer
  • Dynamic:
  • Required:
  • Minimum: >= 1

# maxDuration

  • Type: string
  • Dynamic:
  • Required:
  • Format: duration

# maxInterval

  • Type: string
  • Dynamic:
  • Required: ✔️
  • Format: duration

# minInterval

  • Type: string
  • Dynamic:
  • Required: ✔️
  • Format: duration

# warningOnRetry

  • Type: boolean
  • Dynamic:
  • Required:
  • Default: false

# Exponential

# delayFactor

  • Type: number
  • Dynamic:
  • Required:

# interval

  • Type: string
  • Dynamic:
  • Required: ✔️
  • Format: duration

# maxAttempt

  • Type: integer
  • Dynamic:
  • Required:
  • Minimum: >= 1

# maxDuration

  • Type: string
  • Dynamic:
  • Required:
  • Format: duration

# maxInterval

  • Type: string
  • Dynamic:
  • Required: ✔️
  • Format: duration

# warningOnRetry

  • Type: boolean
  • Dynamic:
  • Required:
  • Default: false