StorageWrite
Load an kestra internal storage file on bigquery using BigQuery Storage API
type: "io.kestra.plugin.gcp.bigquery.StorageWrite"
id: gcp_bq_storage_write
namespace: company.team
tasks:
- id: read_data
type: io.kestra.plugin.core.http.Download
uri: https://dummyjson.com/products/1
- id: storage_write
type: io.kestra.plugin.gcp.bigquery.StorageWrite
from: "{{ outputs.read_data.uri }}"
destinationTable: "my_project.my_dataset.my_table"
writeStreamType: DEFAULT
YES
The table where to load data
The table must be created before.
YES
DEFAULT
DEFAULT
COMMITTED
PENDING
The type of write stream to use
YES
1000
The number of records to send on each query
YES
The fully-qualified URIs that point to source data
YES
The GCP service account to impersonate.
YES
The geographic location where the dataset should reside
This property is experimental and might be subject to change or removed.
See Dataset Location
YES
The GCP project ID.
YES
["https://www.googleapis.com/auth/cloud-platform"]
The GCP scopes to be used.
YES
The GCP service account.
date-time
Commit time reported by BigQuery, only on PENDING
writeStreamType
Rows count
Rows count reported by BigQuery, only on PENDING
writeStreamType