Quickwit List

Quickwit List

Certified

List Quickwit indexes

Returns the metadata of every index present in the metastore.

yaml
type: io.kestra.plugin.quickwit.index.List

List the indexes of a cluster

yaml
id: quickwit_list_indexes
namespace: company.team

tasks:
  - id: list
    type: io.kestra.plugin.quickwit.index.List
    url: "http://localhost:7280"

  - id: report
    type: io.kestra.plugin.core.log.Log
    message: "{{ outputs.list.indexes | jq('.[] | .index_config.index_id') | join(', ') }}"
Properties

Quickwit URL

Base URL of the Quickwit REST API, including the scheme. The api/v1 prefix is added automatically. A local node listens on port 7280, e.g. http://localhost: 7280.

Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.

Definitions
assetFailureBehaviorstring
Possible Values
IGNOREFAILWARN

Asset failure behavior

Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.

enableAutobooleanstring

Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.

inputsarray

The assets consumed as inputs.

id*string
Min length1
typestring
outputs

The assets produced as outputs.

id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*string
Min length1

Custom asset type

descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150

Basic authentication

Optional HTTP basic authentication credentials.

Quickwit itself has no authentication layer, so this is only needed when the cluster sits behind a reverse proxy or an API gateway that enforces basic auth.

Definitions
passwordstring

Password

Password for HTTP basic authentication.

usernamestring

Username

Username for HTTP basic authentication.

Connect timeout

Maximum time to wait to establish a connection to Quickwit, e.g. PT10S. When unset, the default of the underlying HTTP client applies.

Custom HTTP headers

Headers sent on every request, for example an Authorization: Bearer ... token or a gateway API key.

Quickwit itself has no authentication layer, so this is only needed when the cluster sits behind an API gateway that injects credentials.

Read timeout

Maximum time to keep waiting for data on an idle connection, e.g. PT5M. A commit=force ingest or a large search may legitimately take a while, so raise it when needed.

Indexes

Metadata of every index present in the metastore.

Definitions

Configuration and state of a Quickwit index.

checkpointobject

Source checkpoints

Last committed checkpoint of each source attached to the index, keyed by source ID.

create_timestampinteger

Creation timestamp

Creation timestamp of the index, in seconds.

index_configobject

Index configuration

The effective index configuration, including its doc mapping, indexing settings, search settings and retention policy.

index_uidstring

Index UID

Server-generated unique identifier of the index.

sourcesarray

Sources

Sources attached to this index.

Configuration of a source feeding a Quickwit index.

num_pipelinesinteger

Number of pipelines

Number of indexing pipelines running per node for this source. Defaults to 1.

paramsobject

Source parameters

Parameters of the source, whose shape depends on the source type.

source_idstring

Source ID

Unique identifier of the source within its index.

source_typestring

Source type

Type of the source: kafka, kinesis or pulsar.

transformstring

Transform

VRL transformation applied to incoming documents, if any.

versionstring

Configuration format version

Format version of the source configuration, matching the Quickwit version of the cluster.

versionstring

Configuration format version

Format version of the index configuration, matching the Quickwit version of the cluster.

Index count

Number of indexes returned.