Typesense BulkIndex

Typesense BulkIndex

Certified

Bulk upsert documents into Typesense

Streams records from an Amazon ION file in internal storage and upserts them into the target collection.

yaml
type: io.kestra.plugin.typesense.BulkIndex

Index documents to a Typesense DB from an ION file

yaml
id: typesense_bulk_index
namespace: company.team

tasks:
  - id: bulk_index
    type: io.kestra.plugin.typesense.BulkIndex
    apiKey: "{{ secret('TYPESENSE_API_KEY') }}"
    port: 8108
    host: localhost
    collection: Countries
    from: kestra://data/countries.ion
Properties

Typesense API key

Admin or search key used for this request; must allow access to the target collection

Collection name

Name of the Typesense collection; value is rendered before each call

Input ION file URI

kestra:// or other storage URI pointing to an Amazon ION file with one JSON document per line.

Typesense host

Hostname or IP address of the Typesense cluster node or load balancer

Typesense port

TCP port for the Typesense HTTP API; 8108 is the Typesense default

Default1000

Bulk chunk size

Number of documents per Typesense bulk call. Default 1000; lower to reduce memory, raise to improve throughput.

Use HTTPS

Default false (HTTP). Set to true to call Typesense over HTTPS/TLS

Reference (ref) of the pluginDefaults to apply to this task.

Indexed document count

Total number of documents read from the input and sent to Typesense.

Number of records

Number of request