List file on a GCS bucket.
type: "io.kestra.plugin.gcp.gcs.List"
List files in a bucket
id: gcp_gcs_list
namespace: company.team
tasks:
- id: list
type: io.kestra.plugin.gcp.gcs.List
from: "gs://my_bucket/dir/"
The directory to list
The filter files or directory
The GCP service account to impersonate.
The listing type you want (like directory or recursive)
if DIRECTORY, will only list objects in the specified directory
if RECURSIVE, will list objects in the specified directory recursively
Default value is DIRECTORY
When using RECURSIVE value, be careful to move your files to a location not in the from
scope
The GCP project ID.
A regexp to filter on full path
ex:
regExp: .*
to match all files
regExp: .*2020-01-0.\\.csv
to match files between 01 and 09 of january ending with .csv
The GCP scopes to be used.
The GCP service account.