ESC
Ask Kestra AI
ESC
Kestra AI

Hi! I'm your Kestra AI assistant.
Ask me anything about workflows.

EXAMPLE QUESTIONS

How to handle errors & retry on flow?
How to run dbt?
How to prevent concurrent execution of the same flow?

OpenSearch Bulk

OpenSearch Bulk

Certified

Replay bulk request file to OpenSearch

Streams a preformatted bulk file (action + source lines) to the OpenSearch Bulk API; honors connection headers, routing, and chunking.

yaml
type: io.kestra.plugin.opensearch.Bulk

Send a preformatted Bulk API file (action + source lines).

yaml
id: opensearch_bulk_load
namespace: company.team

inputs:
  - id: file
    type: FILE

tasks:
  - id: bulk_load
    type: io.kestra.plugin.opensearch.Bulk
    connection:
      hosts:
        - "http://localhost:9200"
    from: "{{ inputs.file }}"
    # `inputs.file` must contain alternating action and source lines as expected by the Bulk API.
Properties

Configure OpenSearch connection

Hosts, auth headers, and TLS options reused by every task invocation.

Definitions
hosts*array
SubTypestring

OpenSearch HTTP endpoints

One or more host URLs with scheme and port, e.g. https://opensearch.com: 9200; all are used for load-balancing/failover.

basicAuth

Basic auth configuration

passwordstring

Basic auth password

usernamestring

Basic auth username

connectTimeoutstring

Connection timeout

Maximum time to wait when establishing the TCP connection to an OpenSearch node before giving up. RestClient's own default is 1 second when this is left unset.

headersarray
SubTypestring

Additional HTTP headers

Each entry is Key: Value, e.g. Authorization: Token XYZ; rendered per request.

pathPrefixstring

Path prefix for every request

Prepends /my/path to all endpoints when OpenSearch is behind a proxy enforcing a base path; leave unset otherwise.

responseTimeoutstring

Response timeout

Maximum time to wait for a response once a request has been sent to an OpenSearch node before giving up. RestClient's own default is 30 seconds when this is left unset.

strictDeprecationModebooleanstring

Fail on warning headers

If true, any response containing an OpenSearch warning header is treated as a failure; defaults to server/client behavior.

trustAllSslbooleanstring

Trust all SSL certificates

WARNING — SECURITY RISK: When enabled, disables TLS certificate chain validation, allowing connections to servers with self-signed or otherwise untrusted certificates. Hostname verification remains enforced to reduce (but not eliminate) exposure to man-in-the-middle attacks. Must never be used against production clusters or over untrusted networks. Prefer supplying a trusted CA certificate/trust store instead.

Source file in Internal Storage

Path to Kestra internal storage object containing line-delimited JSON or ION records.

Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.

Definitions
assetFailureBehaviorstring
Possible Values
IGNOREFAILWARN

Asset failure behavior

Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.

enableAutobooleanstring

Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.

inputsarray

The assets consumed as inputs.

id*string
Min length1
typestring
outputs

The assets produced as outputs.

id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*string
Min length1

Custom asset type

descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
Default1000

Bulk chunk size

Number of operations per bulk request; defaults to 1000.

Shard routing key

Hashes routing using this value instead of the document id to colocate related records.

Number of records sent

More Plugins in this Category

Scrapy CLI
Scrapy CLI

Tasks that run Scrapy spiders and CLI commands to scrape data from websites.

Data

1 tasks

Supabase
Supabase

Tasks that call Supabase APIs for data and storage operations.

Data

5 tasks