Elasticsearch LogExporter

Elasticsearch LogExporter
Certified
Enterprise Edition
Bulk export logs to Elasticsearch

Streams execution logs to an Elasticsearch index via the Bulk API. Uses rendered indexName and chunk for batching (default 1000 records per bulk request); document IDs are derived from log timestamps, so ensure index mappings accept the task log schema.

yaml
type: io.kestra.plugin.ee.elasticsearch.LogExporter

Examples

Ship logs to Elasticsearch

yaml
id: log_shipper
namespace: company.team

triggers:
  - id: daily
    type: io.kestra.plugin.core.trigger.Schedule
    cron: "@daily"

tasks:
  - id: logSync
    type: io.kestra.plugin.ee.core.log.LogShipper
    logLevelFilter: INFO
    batchSize: 1000
    lookbackPeriod: P1D
    logExporters:
      - id: ElasticsearchLogExporter
        type: io.kestra.plugin.ee.elasticsearch.LogExporter
        connection:
          hosts:
            - "http://localhost:9200/"
        indexName: "logs"

Properties

connection *

Elasticsearch connection settings

Hosts, authentication, headers, and TLS options reused for all requests.

Definitions

io.kestra.plugin.elasticsearch.shared.ElasticsearchConnection

hosts*array

SubTypestring

Min items1

Elasticsearch hosts

List of HTTP(S) endpoints including scheme and port, e.g. https://elasticsearch.com: 9200; at least one is required.

basicAuth

Basic authentication

Optional HTTP basic auth credentials rendered at runtime.

io.kestra.plugin.elasticsearch.shared.ElasticsearchConnection-BasicAuth

passwordstring

Basic auth password

Password for HTTP basic authentication.

usernamestring

Basic auth username

Username for HTTP basic authentication.

connectTimeoutstring

Connection timeout

Maximum time to wait to establish the TCP connection to an Elasticsearch host. When unset, the Elasticsearch client default applies (1 second). A value of PT0S means no timeout.

headersarray

SubTypestring

Custom HTTP headers

Headers sent on every request in Name: Value format, e.g. Authorization: Token XYZ.

pathPrefixstring

Request path prefix

Base path prepended to every Elasticsearch endpoint, e.g. /my/path. Use only when the cluster is served behind a proxy that requires a prefix; leave empty otherwise.

responseTimeoutstring

Response timeout

Maximum time to wait for a response once the request has been sent. When unset, the Elasticsearch client default applies (unbounded), so large bulk requests are not cut off. A value of PT0S means no timeout. Set a bound (e.g. PT60S) to protect against a hung cluster.

strictDeprecationModebooleanstring

Fail on warning headers

When true, any response containing Elasticsearch warning headers is treated as an error.

targetServerVersionintegerstring

Default8

Target Elasticsearch server major version

Major version used for compatibility headers (Accept and Content-Type). Set to 8 for Elasticsearch 8 clusters or 9 for Elasticsearch 9 clusters.

trustAllSslbooleanstring

Trust all SSL certificates

WARNING — SECURITY RISK: When enabled, disables BOTH TLS certificate validation (TrustAllStrategy) AND hostname verification (NoopHostnameVerifier). This makes the connection vulnerable to man-in-the-middle attacks and must never be used in production. Prefer configuring a proper truststore for self-signed certificates instead.

id *string

Validation RegExp^[a-zA-Z0-9][a-zA-Z0-9_-]*

Min length1

indexName *string

Target index name

Rendered per execution; index must accept the task log schema.

chunk integerstring

Default1000

Bulk chunk size

Number of log documents per bulk request (default 1000); tune for throughput versus memory.

Metrics

records counter

The number of records sent to Elasticsearch

requests.count counter

The number of requests sent to Elasticsearch

requests.duration timer

The duration of the requests sent to Elasticsearch

Azure

Enterprise

Tasks that integrate Microsoft Azure services into Kestra enterprise workflows.

CloudDataInfrastructure

Elasticsearch

Tasks that query and write to Elasticsearch clusters for search, indexing, bulk ingestion, and ES|QL.

DataInfrastructure

Elasticsearch LogExporterCertifiedEnterprise EditionBulk export logs to Elasticsearch

Elasticsearch LogExporter

More Plugins in this Category

Azure

Elasticsearch

Elasticsearch LogExporter
Certified
Enterprise Edition
Bulk export logs to Elasticsearch