Google Cloud TableMetadata

Google Cloud TableMetadata
Certified
Get BigQuery table metadata

Retrieves metadata for a table or partition. Can return empty output instead of failing when the table is missing.

yaml
type: io.kestra.plugin.gcp.bigquery.TableMetadata

Examples

yaml
id: gcp_bq_table_metadata
namespace: company.team

tasks:
  - id: table_metadata
    type: io.kestra.plugin.gcp.bigquery.TableMetadata
    projectId: my-project
    dataset: my-dataset
    table: my-table

Properties

dataset *string

Dataset ID

Target dataset name

table *string

Table ID

Target table name

ifNotExists string

DefaultERROR

Possible Values

ERRORSKIP

Missing table policy

ERROR by default. Use SKIP to return an empty output when the table does not exist.

impersonatedServiceAccount string

The GCP service account to impersonate

location string

Dataset location

Optional BigQuery location for created or targeted resources. Experimental and may change; see BigQuery dataset location documentation.

pluginDefaultsRef string

Reference (ref) of the pluginDefaults to apply to this task.

projectId string

The GCP project ID

retryAuto

Automatic BigQuery retry policy

Optional custom retry policy for retryable BigQuery errors. If unset, uses an exponential backoff starting at 5s (per-attempt interval capped at 60m), with a total duration of up to 15m and a maximum of 10 attempts.

Definitions

Constant retry

Retry with a fixed delay between attempts.

interval*string

Formatduration

type*object

behaviorstring

DefaultRETRY_FAILED_TASK

Possible Values

RETRY_FAILED_TASKCREATE_NEW_EXECUTION

maxAttemptsinteger

Minimum>= 1

maxDurationstring

Formatduration

warningOnRetryboolean

Defaultfalse

Exponential retry

Retry with exponentially increasing delays between attempts.

interval*string

Formatduration

maxInterval*string

Formatduration

type*object

behaviorstring

DefaultRETRY_FAILED_TASK

Possible Values

RETRY_FAILED_TASKCREATE_NEW_EXECUTION

delayFactornumber

maxAttemptsinteger

Minimum>= 1

maxDurationstring

Formatduration

warningOnRetryboolean

Defaultfalse

Random retry

Retry with a random delay within a configurable range between attempts.

maxInterval*string

Formatduration

minInterval*string

Formatduration

type*object

behaviorstring

DefaultRETRY_FAILED_TASK

Possible Values

RETRY_FAILED_TASKCREATE_NEW_EXECUTION

maxAttemptsinteger

Minimum>= 1

maxDurationstring

Formatduration

warningOnRetryboolean

Defaultfalse

retryMessages array

SubTypestring

Default["due to concurrent update","Retrying the job may solve the problem","Retrying may solve the problem"]

Retry message substrings

Case-insensitive substrings that, if found in the error message, trigger an automatic retry

retryReasons array

SubTypestring

Default["rateLimitExceeded","jobBackendError","backendError","internalError","jobInternalError"]

Retry reasons

BigQuery error reasons that trigger an automatic retry; evaluated against error reason strings

scopes array

SubTypestring

Default["https://www.googleapis.com/auth/cloud-platform"]

The GCP scopes to be used

serviceAccount string

The GCP service account

Outputs

creationTime string

Formatdate-time

Creation time

datasetId string

Dataset ID

definition

Table definition

Definitions

io.kestra.plugin.gcp.bigquery.models.TableDefinition-Output

externalTableDefinition

io.kestra.plugin.gcp.bigquery.models.ExternalTableDefinition-Output

autodetectboolean

compressionstring

formatTypestring

Possible Values

CSVJSONBIGTABLEDATASTORE_BACKUPAVROGOOGLE_SHEETSPARQUETORC

ignoreUnknownValuesboolean

maxBadRecordsinteger

sourceUrisarray

SubTypestring

materializedViewDefinition

io.kestra.plugin.gcp.bigquery.models.MaterializedViewDefinition-Output

enableRefreshboolean

lastRefreshDatestring

Formatdate-time

querystring

refreshIntervalstring

Formatduration

schema

io.kestra.plugin.gcp.bigquery.models.Schema-Output

fieldsarray

io.kestra.plugin.gcp.bigquery.models.Field-Output

descriptionstring

modestring

Possible Values

NULLABLEREQUIREDREPEATED

namestring

policyTags

subFieldsarray

typestring

Possible Values

BOOLINT64FLOAT64NUMERICBIGNUMERICSTRINGBYTESSTRUCTARRAYTIMESTAMPDATETIMEDATETIMEGEOGRAPHYJSONINTERVALRANGE

standardTableDefinition

io.kestra.plugin.gcp.bigquery.models.StandardTableDefinition-Output

clusteringarray

SubTypestring

rangePartitioning

io.kestra.plugin.gcp.bigquery.models.RangePartitioning-Output

fieldstring

range

streamingBuffer

com.google.cloud.bigquery.StandardTableDefinition-StreamingBuffer

estimatedBytesinteger

estimatedRowsinteger

oldestEntryTimeinteger

timePartitioning

io.kestra.plugin.gcp.bigquery.models.TimePartitioning-Output

expirationstring

Formatduration

fieldstring

requirePartitionFilterboolean

typestring

Possible Values

DAYHOURMONTHYEAR

typestring

Possible Values

TABLEVIEWMATERIALIZED_VIEWEXTERNALMODEL

viewDefinition

io.kestra.plugin.gcp.bigquery.models.ViewDefinition-Output

querystring

viewUserDefinedFunctionsarray

io.kestra.plugin.gcp.bigquery.models.UserDefinedFunction-Output

contentstring

typestring

Possible Values

INLINEFROM_URI

description string

Description

encryptionConfiguration

Encryption configuration

Definitions

io.kestra.plugin.gcp.bigquery.models.EncryptionConfiguration-Output

kmsKeyNamestring

etag string

Table etag

expirationTime string

Formatdate-time

Expiration time

If absent, the table persists indefinitely; expired tables are deleted

friendlyName string

Friendly name

generatedId string

Service-generated table id

labels object

SubTypestring

Labels

lastModifiedTime string

Formatdate-time

Last modified time

numBytes integer

Size in bytes

numLongTermBytes integer

Long-term storage bytes

Bytes billed at long-term storage rates

numRows integer

Row count

projectId string

Project ID

requirePartitionFilter boolean

Require partition filter

True when queries must specify a partition filter for partition elimination

selfLink string

Self link URL

API URL for get or update requests

table string

Table name

Liquibase

Tasks that run Liquibase change management commands.

Data

PostgreSQL

Tasks that connect to PostgreSQL via JDBC to run queries and loads.

Data

Google Cloud TableMetadataCertifiedGet BigQuery table metadata

Google Cloud TableMetadata

More Plugins in this Category

Liquibase

PostgreSQL

Google Cloud TableMetadata
Certified
Get BigQuery table metadata