search
Send a search request to an Elasticsearch cluster.

Send a search request to an Elasticsearch cluster.

Get all documents from a search request and store it as outputs.

yaml
type: "io.kestra.plugin.elasticsearch.search"

Examples

yaml
id: elasticsearch_search
namespace: company.team

tasks:
  - id: search
    type: io.kestra.plugin.elasticsearch.Search
    connection:
      hosts:
        - "http://localhost:9200"
    indexes:
      - "my_index"
    request:
      query:
        term:
          name:
            value: 'john'

Properties

connection*

The connection properties.

Definitions

io.kestra.plugin.elasticsearch.ElasticsearchConnection

hosts*array

SubTypestring

Min items1

List of HTTP ElasticSearch servers.

Must be an URI like https://elasticsearch.com: 9200 with scheme and port.

basicAuth

Basic auth configuration.

io.kestra.plugin.elasticsearch.ElasticsearchConnection-BasicAuth

passwordstring

Basic auth password.

usernamestring

Basic auth username.

headersarray

SubTypestring

List of HTTP headers to be send on every request.

Must be a string with key value separated with : , ex: Authorization: Token XYZ.

pathPrefixstring

Sets the path's prefix for every request used by the HTTP client.

For example, if this is set to /my/path, then any client request will become /my/path/ + endpoint. In essence, every request's endpoint is prefixed by this pathPrefix. The path prefix is useful for when ElasticSearch is behind a proxy that provides a base path or a proxy that requires all paths to start with '/'; it is not intended for other purposes and it should not be supplied in other scenarios.

strictDeprecationModebooleanstring

Whether the REST client should return any response containing at least one warning header as a failure.

trustAllSslbooleanstring

Trust all SSL CA certificates.

Use this if the server is using a self signed SSL certificate.

request*object

The ElasticSearch value.

Can be a JSON string. In this case, the contentType will be used or a raw Map.

fetchTypestring

DefaultFETCH

Possible Values

STOREFETCHFETCH_ONENONE

The way you want to store the data.

FETCH_ONE output the first row, FETCH output all the rows, STORE store all rows in a file, NONE do nothing.

indexesarray

SubTypestring

The ElasticSearch indices.

Default to all indices.

routingstring

Controls the shard routing of the request.

Using this value to hash the shard and not the id.

Outputs

rowobject

Map containing the first row of fetched data.

Only populated if using fetchType=FETCH_ONE.

rowsarray

SubTypeobject

List containing the fetched data.

Only populated if using fetchType=FETCH.

sizeinteger

The size of the rows fetched.

totalinteger

The total of the rows fetched without pagination.

uristring

Formaturi

The URI of the stored data.

Only populated if using fetchType=STORE.

Metrics

recordscounter

Unitrecords

Number of records returned

requests.countcounter

Number of search requests sent

requests.durationtimer

Duration of search requests

Opensearch

Enterprise

This sub-group of plugins contains tasks for using Opensearch EE. Opensearch is a distributed, RESTful search and analytics engine capable of addressing a growing number of use cases.

Database

OpenSearch

This sub-group of plugins contains tasks for using Opensearch. Opensearch is a distributed, RESTful search and analytics engine capable of addressing a growing number of use cases.

Database