Google Cloud Download
CertifiedDownload a GCS object
Google Cloud Download
Download a GCS object
Reads a gs:// object to a temp file and stores it in Kestra internal storage. Optionally validates the file integrity by recomputing its checksum locally and comparing it to the value stored in GCS.
type: io.kestra.plugin.gcp.gcs.DownloadExamples
id: gcp_gcs_download
namespace: company.team
tasks:
- id: download
type: io.kestra.plugin.gcp.gcs.Download
from: "gs://my_bucket/dir/file.csv"
Download with end-to-end checksum validation
id: gcp_gcs_download_validated
namespace: company.team
tasks:
- id: download
type: io.kestra.plugin.gcp.gcs.Download
from: "gs://my_bucket/dir/file.csv"
validateChecksum: true
Properties
assets
Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.
io.kestra.core.models.assets.AssetsDeclaration
IGNOREFAILWARNAsset failure behavior
Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.
Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.
The assets consumed as inputs.
io.kestra.core.models.assets.AssetIdentifier
1The assets produced as outputs.
io.kestra.plugin.ee.assets.Dataset
1150{}1150io.kestra.plugin.ee.assets.File
1150{}1150io.kestra.plugin.ee.assets.Table
1150{}1150io.kestra.plugin.ee.assets.VM
1150{}1150io.kestra.core.models.assets.External
1150{}1150io.kestra.core.models.assets.Custom
11501Custom asset type
{}1150from string
Source object URI
gs:// path to download
impersonatedServiceAccount string
The GCP service account to impersonate
projectId string
The GCP project ID
scopes array
["https://www.googleapis.com/auth/cloud-platform"]The GCP scopes to be used
serviceAccount string
The GCP service account
validateChecksum booleanstring
falseValidate the downloaded file against the GCS checksum
When true, the file is streamed through a CRC32C hasher (or MD5 if the object has no CRC32C) and compared to the checksum reported by Google Cloud Storage. If the values differ, the task fails and the temporary file is deleted. Used for end-to-end integrity, not for security/authentication.
Outputs
bucket string
Bucket
path string
Object path
uri string
uriKestra storage URI
Internal storage URI where the file was saved
Metrics
checksum.validated counter
Number of files whose checksum was successfully validated after download.
