Quickwit Create

Quickwit Create

Certified

Create a Quickwit delete task

Queues a delete task on an index: every document matching the query is deleted by the janitor of the cluster.

The task only appends the delete task to the metastore queue, so this call returns immediately and the documents are removed asynchronously.

yaml
type: io.kestra.plugin.quickwit.deletetask.Create

Apply a retention policy to yesterday's logs

yaml
id: quickwit_delete_task
namespace: company.team

tasks:
  - id: delete
    type: io.kestra.plugin.quickwit.deletetask.Create
    url: "http://localhost:7280"
    index: app-logs
    query: "*"
    startTimestamp: "{{ now() | dateAdd(-30, 'DAYS') | timestamp }}"
    endTimestamp: "{{ now() | dateAdd(-29, 'DAYS') | timestamp }}"

  - id: report
    type: io.kestra.plugin.core.log.Log
    message: "Queued delete task {{ outputs.delete.opstamp }}"
Properties

Index ID

ID of the index to delete documents from.

Query

Query selecting the documents to delete, using the Quickwit query language, for example message: trash.

The deletion is applied asynchronously by the janitor of the cluster.

Quickwit URL

Base URL of the Quickwit REST API, including the scheme. The api/v1 prefix is added automatically. A local node listens on port 7280, e.g. http://localhost: 7280.

Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.

Definitions
assetFailureBehaviorstring
Possible Values
IGNOREFAILWARN

Asset failure behavior

Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.

enableAutobooleanstring

Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.

inputsarray

The assets consumed as inputs.

id*string
Min length1
typestring
outputs

The assets produced as outputs.

id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*string
Min length1

Custom asset type

descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150

Basic authentication

Optional HTTP basic authentication credentials.

Quickwit itself has no authentication layer, so this is only needed when the cluster sits behind a reverse proxy or an API gateway that enforces basic auth.

Definitions
passwordstring

Password

Password for HTTP basic authentication.

usernamestring

Username

Username for HTTP basic authentication.

Connect timeout

Maximum time to wait to establish a connection to Quickwit, e.g. PT10S. When unset, the default of the underlying HTTP client applies.

End timestamp

Restricts the deletion to documents with timestamp < endTimestamp, in seconds.

Custom HTTP headers

Headers sent on every request, for example an Authorization: Bearer ... token or a gateway API key.

Quickwit itself has no authentication layer, so this is only needed when the cluster sits behind an API gateway that injects credentials.

Read timeout

Maximum time to keep waiting for data on an idle connection, e.g. PT5M. A commit=force ingest or a large search may legitimately take a while, so raise it when needed.

SubTypestring

Search fields

Fields to search on when the query does not qualify a field name.

Start timestamp

Restricts the deletion to documents with timestamp >= startTimestamp, in seconds.

Creation timestamp

Creation timestamp of the delete task, in seconds.

The queued delete task, as Quickwit stored it.

Definitions

A delete task queued on an index, deleting every document matching its query.

create_timestampinteger

Creation timestamp

Creation timestamp of the delete task, in seconds.

delete_query

The query selecting the documents to delete.

Query selecting the documents to delete, restricted to a time range and a set of fields.

end_timestampinteger

End timestamp

Restricts the deletion to documents with timestamp < end_timestamp, in seconds.

querystring

Query

Query text, using the Quickwit query language.

search_fieldarray
SubTypestring

Search fields

Fields to search on when the query does not qualify a field name.

start_timestampinteger

Start timestamp

Restricts the deletion to documents with timestamp >= start_timestamp, in seconds.

opstampinteger

Operation stamp

Unique operation stamp associated with the delete task.

Index ID

ID of the index the delete task was queued on.

Operation stamp

Unique operation stamp of the delete task.