OpenSearch Load

OpenSearch Load

Certified

Bulk load records from Internal Storage

Reads line-delimited JSON/ION from Kestra internal storage and indexes documents in batches.

yaml
type: io.kestra.plugin.opensearch.Load
yaml
id: opensearch_load
namespace: company.team

inputs:
  - id: file
    type: FILE

tasks:
  - id: load
    type: io.kestra.plugin.opensearch.Load
    connection:
      hosts:
        - "http://localhost:9200"
    from: "{{ inputs.file }}"
    index: "my_index"
Properties

Configure OpenSearch connection

Hosts, auth headers, and TLS options reused by every task invocation.

Definitions
hosts*Requiredarray
SubTypestring

OpenSearch HTTP endpoints

One or more host URLs with scheme and port, e.g. https://opensearch.com: 9200; all are used for load-balancing/failover.

basicAuth

Basic auth configuration

passwordstring

Basic auth password

usernamestring

Basic auth username

connectTimeoutstring

Connection timeout

Maximum time to wait when establishing the TCP connection to an OpenSearch node before giving up. RestClient's own default is 1 second when this is left unset.

headersarray
SubTypestring

Additional HTTP headers

Each entry is Key: Value, e.g. Authorization: Token XYZ; rendered per request.

pathPrefixstring

Path prefix for every request

Prepends /my/path to all endpoints when OpenSearch is behind a proxy enforcing a base path; leave unset otherwise.

responseTimeoutstring

Response timeout

Maximum time to wait for a response once a request has been sent to an OpenSearch node before giving up. RestClient's own default is 30 seconds when this is left unset.

strictDeprecationModebooleanstring

Fail on warning headers

If true, any response containing an OpenSearch warning header is treated as a failure; defaults to server/client behavior.

trustAllSslbooleanstring

Trust all SSL certificates

WARNING — SECURITY RISK: When enabled, disables TLS certificate chain validation, allowing connections to servers with self-signed or otherwise untrusted certificates. Hostname verification remains enforced to reduce (but not eliminate) exposure to man-in-the-middle attacks. Must never be used against production clusters or over untrusted networks. Prefer supplying a trusted CA certificate/trust store instead.

Source file in Internal Storage

Path to Kestra internal storage object containing line-delimited JSON or ION records.

Target OpenSearch index

Default1000

Bulk chunk size

Number of operations per bulk request; defaults to 1000.

Field to use as document id

If set, uses this field value as _id; field is removed when removeIdKey is true.

Possible Values
INDEXCREATEUPDATEDELETE

Bulk operation type

Indexing op type; INDEX/CREATE supported, others rejected by client.

Defaulttrue

Remove idKey from document

Defaults to true; keep the id field in the document by setting to false.

Shard routing key

Hashes routing using this value instead of the document id to colocate related records.

Number of records sent

More Plugins in this Category

VMware (EE)
VMware
Enterprise

Tasks that automate VMware vSphere operations within Kestra workflows.

Infrastructure

33 tasks

3 blueprints

Canonical (EE)
Canonical
Enterprise

Tasks to interact with Canonical services, enabling automation and infrastructure management through API-driven workflows.

CloudInfrastructure

5 tasks