AI Weaviate

AI Weaviate

Certified

Store embeddings in Weaviate

Connects to a Weaviate cluster (HTTP + optional gRPC) using the given host/scheme. apiKey, host, port, and objectClass are required. Defaults: scheme "https", avoidDups true, consistency QUORUM, secured gRPC true. drop=true clears the class contents.

yaml
type: io.kestra.plugin.ai.embeddings.Weaviate

Ingest documents into a Weaviate embedding store

yaml
id: document_ingestion
namespace: company.ai

tasks:
  - id: ingest
    type: io.kestra.plugin.ai.rag.IngestDocument
    provider:
      type: io.kestra.plugin.ai.provider.GoogleGemini
      modelName: gemini-embedding-001
      apiKey: "{{ secret('GEMINI_API_KEY') }}"
    embeddings:
      type: io.kestra.plugin.ai.embeddings.Weaviate
      apiKey: "{{ secret('WEAVIATE_API_KEY') }}"
      scheme: https                                 # http | https (defaults to https)
      host: your-cluster-id.weaviate.network        # no protocol
      port: 443                                     # required (e.g. 443 for https, 80 for http)
      objectClass: Documents                        # required; must start with an uppercase letter
    drop: true
    fromExternalURLs:
      - https://raw.githubusercontent.com/kestra-io/docs/refs/heads/main/content/blogs/release-0-24.md
Properties

API key

Weaviate API key. Required to connect to the cluster.

Host

Cluster host name without protocol, e.g., "abc123.weaviate.network".

Object class

Weaviate class to store objects in (must start with an uppercase letter). Required.

Port

Port for the connection (e.g., 443 for https, 80 for http). Required.

Avoid duplicates

If true (default), a hash-based ID is derived from each text segment to prevent duplicates. If false, a random ID is used.

Possible Values
ONEQUORUMALL

Consistency level

Write consistency: ONE, QUORUM (default), or ALL.

gRPC port

Port for gRPC if enabled (e.g., 50051).

Metadata field name

Field used to store metadata. Defaults to "_metadata" if not set.

SubTypestring

Metadata keys

The list of metadata keys to store - if not provided, it will default to an empty list.

Scheme

Cluster scheme: "https" (recommended) or "http".

Secure gRPC

Whether the gRPC connection is secured (TLS). Defaults to true.

Use gRPC for batch inserts

If true, use gRPC for batch inserts. HTTP remains required for search operations.