Google Cloud WriteRows
CertifiedWrite rows to a Google Cloud Bigtable table
Google Cloud WriteRows
Write rows to a Google Cloud Bigtable table
Writes one or more rows as a batch of mutations. Each row can set one or more cells (cells) and/or delete one or more cells (deleteCells) within the configured column family
type: io.kestra.plugin.gcp.bigtable.WriteRowsExamples
Write rows to Bigtable
id: bigtable_write_rows
namespace: company.team
inputs:
- id: table_id
type: STRING
defaults: events
tasks:
- id: write
type: io.kestra.plugin.gcp.bigtable.WriteRows
projectId: "{{ secret('GCP_PROJECT_ID') }}"
instanceId: my-instance
tableId: "{{ inputs.table_id }}"
columnFamily: cf1
rows:
- rowKey: "row-001"
cells:
value: "42"
- id: log
type: io.kestra.plugin.core.log.Log
message: "Written {{ outputs.write.rowCount }} rows to {{ inputs.table_id }}"
Set and delete cells on the same row
id: bigtable_write_rows_with_delete
namespace: company.team
tasks:
- id: write
type: io.kestra.plugin.gcp.bigtable.WriteRows
projectId: "{{ secret('GCP_PROJECT_ID') }}"
instanceId: my-instance
tableId: events
columnFamily: cf1
rows:
- rowKey: "row-001"
cells:
status: "processed"
deleteCells:
- stale_flag
Properties
instanceId *string
The Bigtable instance ID
An instance is a container for your tables within a given GCP project.
projectId *string
The GCP project ID
rows *array
The rows to write
Each row has a row key, a map of column qualifier to cell value to set, and an optional list of column qualifiers to delete
io.kestra.plugin.gcp.bigtable.WriteRows-RowInput
The row key
Map of column qualifier to cell value to set on this row
The column family for this row
Overrides the task-level columnFamily if set
Column qualifiers to delete on this row
tableId *string
The Bigtable table ID to write to
assets
Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.
io.kestra.core.models.assets.AssetsDeclaration
IGNOREFAILWARNAsset failure behavior
Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.
Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.
The assets consumed as inputs.
io.kestra.core.models.assets.AssetIdentifier
1The assets produced as outputs.
io.kestra.plugin.ee.assets.Dataset
1150{}1150io.kestra.plugin.ee.assets.File
1150{}1150io.kestra.plugin.ee.assets.Table
1150{}1150io.kestra.plugin.ee.assets.VM
1150{}1150io.kestra.core.models.assets.External
1150{}1150io.kestra.core.models.assets.Custom
11501Custom asset type
{}1150columnFamily string
The column family to write cells into
Can be overridden per-row by setting columnFamily on an individual row entry
emulatorHost string
Bigtable emulator host (host: port), for local testing only
When set, the task connects to a local Bigtable emulator instead of the real Bigtable service, using plaintext transport and no credentials. Not intended for production use.
impersonatedServiceAccount string
The GCP service account to impersonate
scopes array
The GCP scopes to be used
serviceAccount string
The GCP service account
Outputs
rowCount integer
Number of rows written
Metrics
rows.written counter
rowsNumber of rows written
