pluginsplugin-minio

Downloads​Downloads

Downloads multiple files from a MinIO bucket.

yaml
type: "io.kestra.plugin.minio.Downloads"
yaml
id: minio_downloads
namespace: company.team

tasks:
  - id: downloads
    type: io.kestra.plugin.minio.Downloads
    accessKeyId: "<access-key>"
    secretKeyId: "<secret-key>"
    region: "eu-central-1"
    bucket: "my-bucket"
    prefix: "sub-dir"
    action: "DELETE"

Download files from an S3-compatible storage — here, Spaces Object Storage from Digital Ocean.

yaml
id: s3_compatible_downloads
namespace: company.team

tasks:
  - id: downloads
    type: io.kestra.plugin.minio.Downloads
    accessKeyId: "<access-key>"
    secretKeyId: "<secret-key>"
    endpoint: https://<region>.digitaloceanspaces.com
    bucket: "kestra-test-bucket"
    prefix: "data/orders"
    action: "DELETE"
Properties
Possible Values
MOVEDELETENONE

The action to perform on the retrieved files. If using 'NONE' make sure to handle the files inside your flow to avoid infinite triggering.

Access Key Id for authentication.

The bucket name.

A delimiter is a character you use to group keys.

URL to the MinIO endpoint.

Default BOTH
Possible Values
FILESDIRECTORYBOTH

The type of objects to filter: files, directory, or both.

Marker is where you want to start listing from.

Start listing after this specified key. Marker can be any key in the bucket.

Default 1000

Sets the maximum number of keys returned in the response.

By default, the action returns up to 1,000 key names. The response might contain fewer keys but will never contain more.

The destination bucket and key for MOVE action.

Limits the response to keys that begin with the specified prefix.

A regexp to filter on full key.

ex: regExp: .* to match all files regExp: .*2020-01-0.\\.csv to match files between 01 and 09 of january ending with .csv

MinIO region with which the SDK should communicate.

Secret Key Id for authentication.

SubType

The list of objects.

SubType string

The downloaded files as a map of from/to URIs.

Format date-time
Format uri

The bucket name

The bucket key