MinIO Upload

MinIO Upload

Certified

Upload a file to a MinIO bucket

Uploads a file to a MinIO bucket from Kestra's internal storage.

yaml
type: io.kestra.plugin.minio.Upload
yaml
id: minio_upload
namespace: company.team

inputs:
  - id: file
    type: FILE

tasks:
  - id: upload_to_storage
    type: io.kestra.plugin.minio.Upload
    accessKeyId: "<access-key>"
    secretKeyId: "{{ secret('MINIO_SECRET_KEY_ID') }}"
    region: "eu-central-1"
    from: "{{ inputs.file }}"
    bucket: "my-bucket"
    key: "path/to/file"

Upload file to S3-compatible storage (e.g., DigitalOcean Spaces).

yaml
id: s3_compatible_upload
namespace: company.team

tasks:
  - id: http_download
    type: io.kestra.plugin.core.http.Download
    uri: https://huggingface.co/datasets/kestra/datasets/raw/main/csv/orders.csv

  - id: upload_to_storage
    type: io.kestra.plugin.minio.Upload
    accessKeyId: "<access-key>"
    secretKeyId: "{{ secret('MINIO_SECRET_KEY_ID') }}"
    endpoint: https://<region>.digitaloceanspaces.com
    bucket: "kestra-test-bucket"
    from: "{{ outputs.http_download.uri }}"
    key: "data/orders.csv"
Installation

Our standard Docker images already include this plugin. If you use a -slim image or another setup, install it with the following command:

kestractl plugins get io.kestra.plugin:plugin-minio --compatible-for $KESTRA_VERSION

For kestractl, use your Kestra version with --compatible-for, or specify an exact plugin version.

For Kestra CLI, replace LATEST with a specific version or version range to pin the plugin version.

Properties

Access Key Id for authentication

Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.

Definitions
assetFailureBehaviorstring
Possible Values
IGNOREFAILWARN

Asset failure behavior

Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.

enableAutobooleanstring

Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.

inputsarray

The assets consumed as inputs.

id*string
Min length1
typestring
outputs

The assets produced as outputs.

id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*string
Min length1

Custom asset type

descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150

The bucket name

CA PEM certificate content

CA certificate as text, used to verify SSL/TLS connections to custom MinIO endpoints.

Client PEM certificate content

PEM client certificate as text, used to authenticate the connection to MinIO (mTLS).

A standard MIME type describing the format of the contents

URL to the MinIO endpoint

The file(s) to upload

Can be a single file, a list of files or json array.

Definitions

Lists objects in a MinIO bucket, optionally filtered by prefix, delimiter, or regular expression.

Example
yaml
id: minio_list
namespace: company.team

tasks:
  - id: list_objects
    type: io.kestra.plugin.minio.List
    accessKeyId: "<access-key>"
    secretKeyId: "{{ secret('MINIO_SECRET_KEY_ID') }}"
    region: "eu-central-1"
    bucket: "my-bucket"
    prefix: "sub-dir"

List files from an S3-compatible storage — here, Spaces Object Storage from Digital Ocean.

yaml
id: s3_compatible_list
namespace: company.team

tasks:
  - id: list_objects
    type: io.kestra.plugin.minio.List
    accessKeyId: "<access-key>"
    secretKeyId: "{{ secret('MINIO_SECRET_KEY_ID') }}"
    endpoint: https://<region>.digitaloceanspaces.com
    bucket: "kestra-test-bucket"
accessKeyIdstring

Access Key Id for authentication

assets

Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.

assetFailureBehaviorstring
Possible Values
IGNOREFAILWARN

Asset failure behavior

Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.

enableAutobooleanstring

Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.

inputsarray

The assets consumed as inputs.

id*string
Min length1
typestring
outputs

The assets produced as outputs.

id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*string
Min length1

Custom asset type

descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
bucketstring

The bucket name

caPemstring

CA PEM certificate content

CA certificate as text, used to verify SSL/TLS connections to custom MinIO endpoints.

clientPemstring

Client PEM certificate content

PEM client certificate as text, used to authenticate the connection to MinIO (mTLS).

delimiterstring

A delimiter is a character you use to group keys

endpointstring

URL to the MinIO endpoint

filterstring
DefaultBOTH
Possible Values
FILESDIRECTORYBOTH

The type of objects to filter: files, directory, or both

includeVersionsbooleanstring
Defaulttrue

Indicates whether task should include versions in output

markerstring

Marker is where you want to start listing from

Start listing after this specified key. Marker can be any key in the bucket.

maxKeysintegerstring
Default1000

Sets the maximum number of keys returned in the response

By default, the action returns up to 1,000 key names. The response might contain fewer keys but will never contain more.

prefixstring

Limits the response to keys that begin with the specified prefix

recursivebooleanstring
Defaulttrue

Indicates whether it should look into subfolders

regexpstring

A regexp to filter on full key

ex: regExp: .* to match all files regExp: .*2020-01-0.\\.csv to match files between 01 and 09 of january ending with .csv

regionstring

MinIO region with which the SDK should communicate

secretKeyIdstring

Secret Key Id for authentication

ssl

SSL/TLS configuration options

insecureTrustAllCertificatesbooleanstring

Whether to disable checking of the remote SSL certificate.

Only applies if no trust store is configured. Note: This makes the SSL connection insecure and should only be used for testing. If you are using a self-signed certificate, set up a trust store instead.

startAfterstring

Limits the response to keys that ends with the specified string

typeobject

The key where to upload the file

a full key (with filename) or the directory path if from is multiple files.

A map of metadata to store with the object

MinIO region with which the SDK should communicate

Secret Key Id for authentication

SSL/TLS configuration options

Definitions
insecureTrustAllCertificatesbooleanstring

Whether to disable checking of the remote SSL certificate.

Only applies if no trust store is configured. Note: This makes the SSL connection insecure and should only be used for testing. If you are using a self-signed certificate, set up a trust store instead.

The bucket name

The object key

The version of the object

Unitcount

Number of files successfully uploaded to the MinIO bucket.

Unitbytes

Size of the uploaded files in bytes.