MinIO Upload

MinIO Upload

Certified

Upload a file to a MinIO bucket

Uploads a file to a MinIO bucket from Kestra's internal storage.

yaml
type: io.kestra.plugin.minio.Upload
yaml
id: minio_upload
namespace: company.team

inputs:
  - id: file
    type: FILE

tasks:
  - id: upload_to_storage
    type: io.kestra.plugin.minio.Upload
    accessKeyId: "<access-key>"
    secretKeyId: "{{ secret('MINIO_SECRET_KEY_ID') }}"
    region: "eu-central-1"
    from: "{{ inputs.file }}"
    bucket: "my-bucket"
    key: "path/to/file"

Upload file to S3-compatible storage (e.g., DigitalOcean Spaces).

yaml
id: s3_compatible_upload
namespace: company.team

tasks:
  - id: http_download
    type: io.kestra.plugin.core.http.Download
    uri: https://huggingface.co/datasets/kestra/datasets/raw/main/csv/orders.csv

  - id: upload_to_storage
    type: io.kestra.plugin.minio.Upload
    accessKeyId: "<access-key>"
    secretKeyId: "{{ secret('MINIO_SECRET_KEY_ID') }}"
    endpoint: https://<region>.digitaloceanspaces.com
    bucket: "kestra-test-bucket"
    from: "{{ outputs.http_download.uri }}"
    key: "data/orders.csv"
Properties

Access Key Id for authentication

The bucket name

CA PEM certificate content

CA certificate as text, used to verify SSL/TLS connections to custom MinIO endpoints.

Client PEM certificate content

PEM client certificate as text, used to authenticate the connection to MinIO (mTLS).

A standard MIME type describing the format of the contents

URL to the MinIO endpoint

The file(s) to upload

Can be a single file, a list of files or json array.

Definitions

Lists objects in a MinIO bucket, optionally filtered by prefix, delimiter, or regular expression.

Example
yaml
id: minio_list
namespace: company.team

tasks:
  - id: list_objects
    type: io.kestra.plugin.minio.List
    accessKeyId: "<access-key>"
    secretKeyId: "{{ secret('MINIO_SECRET_KEY_ID') }}"
    region: "eu-central-1"
    bucket: "my-bucket"
    prefix: "sub-dir"

List files from an S3-compatible storage — here, Spaces Object Storage from Digital Ocean.

yaml
id: s3_compatible_list
namespace: company.team

tasks:
  - id: list_objects
    type: io.kestra.plugin.minio.List
    accessKeyId: "<access-key>"
    secretKeyId: "{{ secret('MINIO_SECRET_KEY_ID') }}"
    endpoint: https://<region>.digitaloceanspaces.com
    bucket: "kestra-test-bucket"
accessKeyIdstring

Access Key Id for authentication

bucketstring

The bucket name

caPemstring

CA PEM certificate content

CA certificate as text, used to verify SSL/TLS connections to custom MinIO endpoints.

clientPemstring

Client PEM certificate content

PEM client certificate as text, used to authenticate the connection to MinIO (mTLS).

delimiterstring

A delimiter is a character you use to group keys

endpointstring

URL to the MinIO endpoint

filterstring
DefaultBOTH
Possible Values
FILESDIRECTORYBOTH

The type of objects to filter: files, directory, or both

includeVersionsbooleanstring
Defaulttrue

Indicates whether task should include versions in output

markerstring

Marker is where you want to start listing from

Start listing after this specified key. Marker can be any key in the bucket.

maxKeysintegerstring
Default1000

Sets the maximum number of keys returned in the response

By default, the action returns up to 1,000 key names. The response might contain fewer keys but will never contain more.

pluginDefaultsRefstring

Reference (ref) of the pluginDefaults to apply to this task.

prefixstring

Limits the response to keys that begin with the specified prefix

recursivebooleanstring
Defaulttrue

Indicates whether it should look into subfolders

regexpstring

A regexp to filter on full key

ex: regExp: .* to match all files regExp: .*2020-01-0.\\.csv to match files between 01 and 09 of january ending with .csv

regionstring

MinIO region with which the SDK should communicate

secretKeyIdstring

Secret Key Id for authentication

ssl

SSL/TLS configuration options

insecureTrustAllCertificatesbooleanstring

Whether to disable checking of the remote SSL certificate.

Only applies if no trust store is configured. Note: This makes the SSL connection insecure and should only be used for testing. If you are using a self-signed certificate, set up a trust store instead.

startAfterstring

Limits the response to keys that ends with the specified string

typeobject

The key where to upload the file

a full key (with filename) or the directory path if from is multiple files.

A map of metadata to store with the object

Reference (ref) of the pluginDefaults to apply to this task.

MinIO region with which the SDK should communicate

Secret Key Id for authentication

SSL/TLS configuration options

Definitions
insecureTrustAllCertificatesbooleanstring

Whether to disable checking of the remote SSL certificate.

Only applies if no trust store is configured. Note: This makes the SSL connection insecure and should only be used for testing. If you are using a self-signed certificate, set up a trust store instead.

The bucket name

The object key

The version of the object

Unitcount

Number of files successfully uploaded to the MinIO bucket.

Unitbytes

Size of the uploaded files in bytes.

More Plugins in this Category

Liquibase
Liquibase

Tasks that run Liquibase change management commands.

Data

2 tasks

PostgreSQL
PostgreSQL

Tasks that connect to PostgreSQL via JDBC to run queries and loads.

Data

6 tasks

25 blueprints