Bulk load documents in OpenSearch using bulk files.
type: "io.kestra.plugin.opensearch.Bulk"id: opensearch_bulk_load
namespace: company.team
inputs:
- id: file
type: FILE
tasks:
- id: bulk_load
type: io.kestra.plugin.opensearch.Bulk
connection:
hosts:
- "http://localhost:9200"
from: "{{ inputs.file }}"
NOThe connection properties.
YESThe source file.
YES1000YESControls the shard routing of the request.
Using this value to hash the shard and not the id.
The size of the rows fetched.
YESList of HTTP OpenSearch servers.
Must be an URI like https://opensearch.com: 9200 with scheme and port.
NOBasic auth configuration.
YESList of HTTP headers to be send on every request.
Must be a string with key value separated with : , ex: Authorization: Token XYZ.
YESSets the path's prefix for every request used by the HTTP client.
For example, if this is set to /my/path, then any client request will become /my/path/ + endpoint.
In essence, every request's endpoint is prefixed by this pathPrefix.
The path prefix is useful for when OpenSearch is behind a proxy that provides a base path or a proxy that requires all paths to start with '/'; it is not intended for other purposes and it should not be supplied in other scenarios.
YESYESYESBasic auth password.
YESBasic auth username.