🚀 New! Kestra raises $3 million to grow Learn more

PLUGINSPLUGIN-GCPTASKSBIGQUERYIO.KESTRA.PLUGIN.GCP.BIGQUERY.DELETEPARTITIONS

​Delete​Partitions

DeletePartitions DeletePartitions

yaml
type: "io.kestra.plugin.gcp.bigquery.DeletePartitions"

Delete partitions between interval

Examples

yaml
id: "delete_partitions"
type: "io.kestra.plugin.gcp.bigquery.DeletePartitions"
projectId: my-project
dataset: my-dataset
table: my-table
partitionType: DAY
from: "{{ now() | dateAdd(-30, 'DAYS') }}"
to: "{{ now() | dateAdd(-7, 'DAYS') }}"

Properties

dataset

  • Type: string
  • Dynamic: ✔️
  • Required: ✔️

The dataset's user-defined id

from

  • Type: string
  • Dynamic: ✔️
  • Required: ✔️

The inclusive starting date or integer

If the partition :- is a numeric range, must be a valid integer

  • is a date, must a valid datetime like null

partitionType

  • Type: string
  • Dynamic: ✔️
  • Required: ✔️
  • Possible Values:
    • DAY
    • HOUR
    • MONTH
    • YEAR
    • RANGE

The partition type of the table

table

  • Type: string
  • Dynamic: ✔️
  • Required: ✔️

The table user-defined id

to

  • Type: string
  • Dynamic: ✔️
  • Required: ✔️

The inclusive ending date or integer

If the partition :- is a numeric range, must be a valid integer

  • is a date, must a valid datetime like null

location

  • Type: string
  • Dynamic: ✔️
  • Required: ❌

The geographic location where the dataset should reside

This property is experimental and might be subject to change or removed.

See Dataset Location

projectId

  • Type: string
  • Dynamic: ✔️
  • Required: ❌

The GCP project id

retryAuto

retryMessages

  • Type: array
  • SubType: string
  • Dynamic: ✔️
  • Required: ❌
  • Default: [due to concurrent update, Retrying the job may solve the problem]

The message that are valid for a automatic retry.

Message is tested as a substring of the full message and case insensitive

retryReasons

  • Type: array
  • SubType: string
  • Dynamic: ✔️
  • Required: ❌
  • Default: [rateLimitExceeded, jobBackendError, internalError, jobInternalError]

The reason that are valid for a automatic retry.

scopes

  • Type: array
  • SubType: string
  • Dynamic: ✔️
  • Required: ❌
  • Default: [https://www.googleapis.com/auth/cloud-platform]

The GCP scopes to used

serviceAccount

  • Type: string
  • Dynamic: ✔️
  • Required: ❌

The GCP service account key

Outputs

datasetId

  • Type: string

The dataset's id

partitions

  • Type: array
  • SubType: string

Partitions deleted

projectId

  • Type: string

The project's id

table

  • Type: string

The table name

Definitions

Constant

interval

  • Type: string
  • Dynamic: ❓
  • Required: ✔️
  • Format: duration

type

  • Type: string
  • Dynamic: ❓
  • Required: ✔️
  • Default: constant

maxAttempt

  • Type: integer
  • Dynamic: ❓
  • Required: ❌
  • Minimum: >= 1

maxDuration

  • Type: string
  • Dynamic: ❓
  • Required: ❌
  • Format: duration

warningOnRetry

  • Type: boolean
  • Dynamic: ❓
  • Required: ❌
  • Default: false

Random

maxInterval

  • Type: string
  • Dynamic: ❓
  • Required: ✔️
  • Format: duration

minInterval

  • Type: string
  • Dynamic: ❓
  • Required: ✔️
  • Format: duration

type

  • Type: string
  • Dynamic: ❓
  • Required: ✔️
  • Default: random

maxAttempt

  • Type: integer
  • Dynamic: ❓
  • Required: ❌
  • Minimum: >= 1

maxDuration

  • Type: string
  • Dynamic: ❓
  • Required: ❌
  • Format: duration

warningOnRetry

  • Type: boolean
  • Dynamic: ❓
  • Required: ❌
  • Default: false

Exponential

interval

  • Type: string
  • Dynamic: ❓
  • Required: ✔️
  • Format: duration

maxInterval

  • Type: string
  • Dynamic: ❓
  • Required: ✔️
  • Format: duration

type

  • Type: string
  • Dynamic: ❓
  • Required: ✔️
  • Default: exponential

delayFactor

  • Type: number
  • Dynamic: ❓
  • Required: ❌

maxAttempt

  • Type: integer
  • Dynamic: ❓
  • Required: ❌
  • Minimum: >= 1

maxDuration

  • Type: string
  • Dynamic: ❓
  • Required: ❌
  • Format: duration

warningOnRetry

  • Type: boolean
  • Dynamic: ❓
  • Required: ❌
  • Default: false