List file on a GCS bucket.
yaml
type: "io.kestra.plugin.gcp.gcs.compose"Concat files in a bucket
yaml
id: gcp_gcs_compose
namespace: company.team
tasks:
- id: compose
type: io.kestra.plugin.gcp.gcs.Compose
list:
from: "gs://my_bucket/dir/"
to: "gs://my_bucket/destination/my-compose-file.txt"
The directory to list
Default
falseif true, don't failed if no result
The GCP service account to impersonate.
The GCP project ID.
SubType string
Default
["https://www.googleapis.com/auth/cloud-platform"]The GCP scopes to be used.
The GCP service account.
The destination path
Format
uriThe directory to list
Default
BOTH Possible Values
FILESDIRECTORYBOTH Default
DIRECTORY Possible Values
RECURSIVEDIRECTORYThe listing type you want (like directory or recursive)
if DIRECTORY, will only list objects in the specified directory
if RECURSIVE, will list objects in the specified directory recursively
Default value is DIRECTORY
When using RECURSIVE value, be careful to move your files to a location not in the from scope
A regexp to filter on full path
ex:
regExp: .* to match all files
regExp: .*2020-01-0.\\.csv to match files between 01 and 09 of january ending with .csv