BatchCreate

type: "io.kestra.plugin.weaviate.BatchCreate"

Batch-insert data to a Weaviate database.

Data can be either in an ION-serialized file format or as a list of key-value pairs. If the schema doesn't exist yet, it will be created automatically.

Examples

Send batch object creation request to a Weaviate database

id: weaviate_batch_load
namespace: dev

tasks:
  - id: batch_load
    type: io.kestra.plugin.weaviate.BatchCreate
    url: "https://demo-cluster-id.weaviate.network"
    apiKey: "{{ secret('WEAVIATE_API_KEY') }}"
    className: WeaviateDemo
    objects:
      - textField: "some text"
        numField: 24
      - textField: "another text"
        numField: 42

Send batch object creation request to a Weaviate database using an ION input file e.g. passed from output of another task

id: weaviate_batch_insert
namespace: dev

tasks:
  - id: extract
    type: io.kestra.plugin.fs.http.Download
    uri: https://huggingface.co/datasets/kestra/datasets/raw/main/ion/ingest.ion

  - id: batch_insert
    type: io.kestra.plugin.weaviate.BatchCreate
    url: "https://demo-cluster-id.weaviate.network"
    apiKey: "{{ secret('WEAVIATE_API_KEY') }}"
    className: Titles
    objects: "{{ outputs.extract.uri }}"

Properties

objects

• Type:
  • string
  • array
• Dynamic: ❓
• Required: ✔️

Objects to create with their properties

ION File URI or the list of objects to insert

url

• Type: string
• Dynamic: ✔️
• Required: ✔️
• Min length: 1

Connection URL

Example: localhost:8080 or https://cluster-id.weaviate.network

apiKey

• Type: string
• Dynamic: ✔️
• Required: ❌

API key to authenticate with a managed Weaviate cluster

If not provided, the anonymous authentication scheme will be used.

className

• Type: string
• Dynamic: ✔️
• Required: ❌

Class name where you want to insert data

headers

• Type: object
• SubType: string
• Dynamic: ✔️
• Required: ❌

Additional headers to add to the request e.g. to authenticate with OpenAI API