Downloads
Downloads multiple files from a bucket.
type: "io.kestra.plugin.minio.Downloads"
id: minio_downloads
namespace: company.team
tasks:
- id: downloads
type: io.kestra.plugin.minio.Downloads
accessKeyId: "<access-key>"
secretKeyId: "<secret-key>"
region: "eu-central-1"
bucket: "my-bucket"
prefix: "sub-dir"
action: "DELETE"
Download files from an S3-compatible storage — here, Spaces Object Storage from Digital Ocean.
id: s3_compatible_downloads
namespace: company.team
tasks:
- id: downloads
type: io.kestra.plugin.minio.Downloads
accessKeyId: "<access-key>"
secretKeyId: "<secret-key>"
endpoint: https://<region>.digitaloceanspaces.com
bucket: "kestra-test-bucket"
prefix: "data/orders"
action: "DELETE"
YES
MOVE
DELETE
NONE
The action to perform on the retrieved files. If using 'NONE' make sure to handle the files inside your flow to avoid infinite triggering.
YES
Access Key Id for authentication.
YES
The bucket name.
YES
A delimiter is a character you use to group keys.
YES
URL to the MinIO endpoint.
YES
BOTH
FILES
DIRECTORY
BOTH
The type of objects to filter: files, directory, or both.
YES
Marker is where you want to start listing from.
Start listing after this specified key. Marker can be any key in the bucket.
YES
1000
YES
The destination bucket and key for MOVE
action.
YES
Limits the response to keys that begin with the specified prefix.
YES
A regexp to filter on full key.
ex:
regExp: .*
to match all files
regExp: .*2020-01-0.\\.csv
to match files between 01 and 09 of january ending with .csv
YES
MinIO region with which the SDK should communicate.
YES
Secret Key Id for authentication.
NO
NO
NO
date-time
NO
NO
NO
uri
YES
The bucket name
YES
The bucket key
NO
NO