CreateTable

yaml
type: "io.kestra.plugin.gcp.bigquery.CreateTable"

Examples

yaml
id: gcp_bq_create_table
namespace: company.team

tasks:
  - id: create_table
    type: io.kestra.plugin.gcp.bigquery.CreateTable
    projectId: my-project
    dataset: my-dataset
    table: my-table
    tableDefinition:
      type: TABLE
      schema:
        fields:
        - name: id
          type: INT64
        - name: name
          type: STRING
      standardTableDefinition:
        clustering:
        - id
        - name
    friendlyName: new_table

Properties

dataset *string

table *string

description string

encryptionConfiguration

Definitions

io.kestra.plugin.gcp.bigquery.models.EncryptionConfiguration

The KMS key name.string

expirationDuration string

friendlyName string

impersonatedServiceAccount string

labels object

SubTypestring

location string

projectId string

requirePartitionFilter booleanstring

retryAuto

Definitions

io.kestra.core.models.tasks.retrys.Constant

interval*string

Formatduration

type*object

behaviorstring

DefaultRETRY_FAILED_TASK

Possible Values

RETRY_FAILED_TASKCREATE_NEW_EXECUTION

maxAttemptsinteger

Minimum>= 1

maxDurationstring

Formatduration

warningOnRetryboolean

Defaultfalse

io.kestra.core.models.tasks.retrys.Exponential

interval*string

Formatduration

maxInterval*string

Formatduration

type*object

behaviorstring

DefaultRETRY_FAILED_TASK

Possible Values

RETRY_FAILED_TASKCREATE_NEW_EXECUTION

delayFactornumber

maxAttemptsinteger

Minimum>= 1

maxDurationstring

Formatduration

warningOnRetryboolean

Defaultfalse

io.kestra.core.models.tasks.retrys.Random

maxInterval*string

Formatduration

minInterval*string

Formatduration

type*object

behaviorstring

DefaultRETRY_FAILED_TASK

Possible Values

RETRY_FAILED_TASKCREATE_NEW_EXECUTION

maxAttemptsinteger

Minimum>= 1

maxDurationstring

Formatduration

warningOnRetryboolean

Defaultfalse

retryMessages array

SubTypestring

Default["due to concurrent update","Retrying the job may solve the problem","Retrying may solve the problem"]

retryReasons array

SubTypestring

Default["rateLimitExceeded","jobBackendError","backendError","internalError","jobInternalError"]

scopes array

SubTypestring

Default["https://www.googleapis.com/auth/cloud-platform"]

serviceAccount string

tableDefinition

Definitions

io.kestra.plugin.gcp.bigquery.models.TableDefinition

externalTableDefinition

io.kestra.plugin.gcp.bigquery.models.ExternalTableDefinition

autodetectbooleanstring

compressionstring

formatTypestring

Possible Values

CSVJSONBIGTABLEDATASTORE_BACKUPAVROGOOGLE_SHEETSPARQUETORC

ignoreUnknownValuesbooleanstring

maxBadRecordsintegerstring

sourceUrisarray

SubTypestring

materializedViewDefinition

io.kestra.plugin.gcp.bigquery.models.MaterializedViewDefinition

enableRefreshbooleanstring

lastRefreshDatestring

Formatdate-time

querystring

refreshIntervalstring

schema

io.kestra.plugin.gcp.bigquery.models.Schema

The fields associated with this schema.array

io.kestra.plugin.gcp.bigquery.models.Field

descriptionstring

modestring

Possible Values

NULLABLEREQUIREDREPEATED

namestring

policyTags

subFieldsarray

typestring

Possible Values

BOOLINT64FLOAT64NUMERICBIGNUMERICSTRINGBYTESSTRUCTARRAYTIMESTAMPDATETIMEDATETIMEGEOGRAPHYJSONINTERVALRANGE

standardTableDefinition

io.kestra.plugin.gcp.bigquery.models.StandardTableDefinition

clusteringarray

SubTypestring

rangePartitioning

io.kestra.plugin.gcp.bigquery.models.RangePartitioning

The range of range partitioning.

The range partitioning field.string

streamingBuffer

com.google.cloud.bigquery.StandardTableDefinition-StreamingBuffer

estimatedBytesinteger

estimatedRowsinteger

oldestEntryTimeinteger

timePartitioning

io.kestra.plugin.gcp.bigquery.models.TimePartitioning

expirationstring

fieldstring

requirePartitionFilterbooleanstring

typestring

Possible Values

DAYHOURMONTHYEAR

typestring

Possible Values

TABLEVIEWMATERIALIZED_VIEWEXTERNALMODEL

viewDefinition

io.kestra.plugin.gcp.bigquery.models.ViewDefinition

querystring

viewUserDefinedFunctionsarray

io.kestra.plugin.gcp.bigquery.models.UserDefinedFunction

The type of user defined function.string

Possible Values

INLINEFROM_URI

Type of UserDefinedFunctionstring

Outputs

creationTime string

Formatdate-time

datasetId string

definition

Definitions

io.kestra.plugin.gcp.bigquery.models.TableDefinition-Output

externalTableDefinition

io.kestra.plugin.gcp.bigquery.models.ExternalTableDefinition-Output

autodetectboolean

compressionstring

formatTypestring

Possible Values

CSVJSONBIGTABLEDATASTORE_BACKUPAVROGOOGLE_SHEETSPARQUETORC

ignoreUnknownValuesboolean

maxBadRecordsinteger

sourceUrisarray

SubTypestring

materializedViewDefinition

io.kestra.plugin.gcp.bigquery.models.MaterializedViewDefinition-Output

enableRefreshboolean

lastRefreshDatestring

Formatdate-time

querystring

refreshIntervalstring

Formatduration

schema

io.kestra.plugin.gcp.bigquery.models.Schema-Output

fieldsarray

io.kestra.plugin.gcp.bigquery.models.Field-Output

descriptionstring

modestring

Possible Values

NULLABLEREQUIREDREPEATED

namestring

policyTags

subFieldsarray

typestring

Possible Values

BOOLINT64FLOAT64NUMERICBIGNUMERICSTRINGBYTESSTRUCTARRAYTIMESTAMPDATETIMEDATETIMEGEOGRAPHYJSONINTERVALRANGE

standardTableDefinition

io.kestra.plugin.gcp.bigquery.models.StandardTableDefinition-Output

clusteringarray

SubTypestring

rangePartitioning

io.kestra.plugin.gcp.bigquery.models.RangePartitioning-Output

fieldstring

range

streamingBuffer

com.google.cloud.bigquery.StandardTableDefinition-StreamingBuffer

estimatedBytesinteger

estimatedRowsinteger

oldestEntryTimeinteger

timePartitioning

io.kestra.plugin.gcp.bigquery.models.TimePartitioning-Output

expirationstring

Formatduration

fieldstring

requirePartitionFilterboolean

typestring

Possible Values

DAYHOURMONTHYEAR

typestring

Possible Values

TABLEVIEWMATERIALIZED_VIEWEXTERNALMODEL

viewDefinition

io.kestra.plugin.gcp.bigquery.models.ViewDefinition-Output

querystring

viewUserDefinedFunctionsarray

io.kestra.plugin.gcp.bigquery.models.UserDefinedFunction-Output

contentstring

typestring

Possible Values

INLINEFROM_URI

description string

encryptionConfiguration

Definitions

io.kestra.plugin.gcp.bigquery.models.EncryptionConfiguration-Output

kmsKeyNamestring

etag string

expirationTime string

Formatdate-time

friendlyName string

generatedId string

labels object

SubTypestring

lastModifiedTime string

Formatdate-time

numBytes integer

numLongTermBytes integer

numRows integer

projectId string

requirePartitionFilter boolean

selfLink string

table string

Core Plugins and tasks

Tasks that provide Kestra's built-in orchestration, I/O, and observability capabilities.

CoreStorageScript

PostgreSQL

Tasks that connect to PostgreSQL via JDBC to run queries and loads.

Database

Couchbase

Tasks that execute Couchbase N1QL queries and trigger Kestra flows from query results.

Database

CreateTable

More Plugins in this Category

Core Plugins and tasks

PostgreSQL

Couchbase

2.0.0