Google Cloud WriteRows

Google Cloud WriteRows

Certified

Write rows to a Google Cloud Bigtable table

Writes one or more rows as a batch of mutations. Each row can set one or more cells (cells) and/or delete one or more cells (deleteCells) within the configured column family

yaml
type: io.kestra.plugin.gcp.bigtable.WriteRows

Write rows to Bigtable

yaml
id: bigtable_write_rows
namespace: company.team

inputs:
  - id: table_id
    type: STRING
    defaults: events

tasks:
  - id: write
    type: io.kestra.plugin.gcp.bigtable.WriteRows
    projectId: "{{ secret('GCP_PROJECT_ID') }}"
    instanceId: my-instance
    tableId: "{{ inputs.table_id }}"
    columnFamily: cf1
    rows:
      - rowKey: "row-001"
        cells:
          value: "42"

  - id: log
    type: io.kestra.plugin.core.log.Log
    message: "Written {{ outputs.write.rowCount }} rows to {{ inputs.table_id }}"

Set and delete cells on the same row

yaml
id: bigtable_write_rows_with_delete
namespace: company.team

tasks:
  - id: write
    type: io.kestra.plugin.gcp.bigtable.WriteRows
    projectId: "{{ secret('GCP_PROJECT_ID') }}"
    instanceId: my-instance
    tableId: events
    columnFamily: cf1
    rows:
      - rowKey: "row-001"
        cells:
          status: "processed"
        deleteCells:
          - stale_flag
Properties

The Bigtable instance ID

An instance is a container for your tables within a given GCP project.

The GCP project ID

The rows to write

Each row has a row key, a map of column qualifier to cell value to set, and an optional list of column qualifiers to delete

Definitions
rowKey*Requiredstring

The row key

cellsobject
SubTypestring

Map of column qualifier to cell value to set on this row

columnFamilystring

The column family for this row

Overrides the task-level columnFamily if set

deleteCellsarray
SubTypestring

Column qualifiers to delete on this row

The Bigtable table ID to write to

The column family to write cells into

Can be overridden per-row by setting columnFamily on an individual row entry

Bigtable emulator host (host: port), for local testing only

When set, the task connects to a local Bigtable emulator instead of the real Bigtable service, using plaintext transport and no credentials. Not intended for production use.

The GCP service account to impersonate

Reference (ref) of the pluginDefaults to apply to this task.

SubTypestring

The GCP scopes to be used

The GCP service account

Number of rows written

Unitrows

Number of rows written

More Plugins in this Category

Liquibase
Liquibase

Tasks that run Liquibase change management commands.

Data

2 tasks

OPA (Open Policy Agent)
OPA (Open Policy Agent)
Enterprise

Tasks to manage Open Policy Agent policies and decisions, including upload, evaluation, and partial evaluation.

Infrastructure

5 tasks

3 blueprints