Google Cloud ReadRows

Google Cloud ReadRows

Certified

Read rows from a Google Cloud Bigtable table

Reads rows from a Bigtable table using an optional row key range, row key prefix, or cell filter. Supports FETCH (return all rows in the output), FETCH_ONE (return only the first row), and STORE (persist all rows to internal storage as ion, recommended for large result sets) fetch types

yaml
type: io.kestra.plugin.gcp.bigtable.ReadRows

Read rows from Bigtable by row key prefix and store the result

yaml
id: bigtable_read_rows
namespace: company.team

tasks:
  - id: read
    type: io.kestra.plugin.gcp.bigtable.ReadRows
    projectId: "{{ secret('GCP_PROJECT_ID') }}"
    instanceId: my-instance
    tableId: sensor-readings
    rowKeyPrefix: "device-42#"
    fetchType: STORE

Read the first row within a row key range

yaml
id: bigtable_read_one_row
namespace: company.team

tasks:
  - id: read
    type: io.kestra.plugin.gcp.bigtable.ReadRows
    projectId: "{{ secret('GCP_PROJECT_ID') }}"
    instanceId: my-instance
    tableId: sensor-readings
    rowKeyStart: "device-42#001"
    rowKeyEnd: "device-42#002"
    fetchType: FETCH_ONE
Properties

The Bigtable instance ID

An instance is a container for your tables within a given GCP project.

The GCP project ID

The Bigtable table ID to read from

Only return cells from this column family

If not set, cells from all column families are returned

Bigtable emulator host (host: port), for local testing only

When set, the task connects to a local Bigtable emulator instead of the real Bigtable service, using plaintext transport and no credentials. Not intended for production use.

DefaultSTORE
Possible Values
STOREFETCHFETCH_ONENONE

Data storage method

FETCH_ONE outputs the first row, FETCH outputs all rows in the output variable, STORE stores all rows to a file in internal storage and is recommended for large result sets

The GCP service account to impersonate

Maximum number of rows to read

If not set, all matching rows are read

Reference (ref) of the pluginDefaults to apply to this task.

Exclusive end of the row key range to scan

Used together with rowKeyStart. Ignored if rowKeyPrefix is set

Row key prefix to filter on

Mutually exclusive with rowKeyStart/rowKeyEnd

Inclusive start of the row key range to scan

Mutually exclusive with rowKeyPrefix. If neither is set, the full table is scanned

SubTypestring

The GCP scopes to be used

The GCP service account

The first matching row (only set when fetchType is FETCH_ONE)

Number of rows read

SubTypeobject

All matching rows (only set when fetchType is FETCH)

Formaturi

URI of the file storing all rows (only set when fetchType is STORE)

More Plugins in this Category

Liquibase
Liquibase

Tasks that run Liquibase change management commands.

Data

2 tasks

OPA (Open Policy Agent)
OPA (Open Policy Agent)
Enterprise

Tasks to manage Open Policy Agent policies and decisions, including upload, evaluation, and partial evaluation.

Infrastructure

5 tasks

3 blueprints