AI Weaviate
CertifiedStore embeddings in Weaviate
AI Weaviate
Store embeddings in Weaviate
Connects to a Weaviate cluster (HTTP + optional gRPC) using the given host/scheme. apiKey, host, port, and objectClass are required. Defaults: scheme "https", avoidDups true, consistency QUORUM, secured gRPC true. drop=true clears the class contents.
type: io.kestra.plugin.ai.embeddings.WeaviateExamples
Ingest documents into a Weaviate embedding store
id: document_ingestion
namespace: company.ai
tasks:
- id: ingest
type: io.kestra.plugin.ai.rag.IngestDocument
provider:
type: io.kestra.plugin.ai.provider.GoogleGemini
modelName: gemini-embedding-001
apiKey: "{{ secret('GEMINI_API_KEY') }}"
embeddings:
type: io.kestra.plugin.ai.embeddings.Weaviate
apiKey: "{{ secret('WEAVIATE_API_KEY') }}"
scheme: https # http | https (defaults to https)
host: your-cluster-id.weaviate.network # no protocol
port: 443 # required (e.g. 443 for https, 80 for http)
objectClass: Documents # required; must start with an uppercase letter
drop: true
fromExternalURLs:
- https://raw.githubusercontent.com/kestra-io/docs/refs/heads/main/content/blogs/release-0-24.md
Properties
apiKey *string
API key
Weaviate API key used to authenticate against the cluster. Store it as a Kestra secret rather than inline. No default: this property is required.
host *string
Host
Cluster hostname, without protocol or port. No default: this property is required.
objectClass *string
Object class
Weaviate class that stores the embedded objects. It must start with an uppercase letter. No default: this property is required.
port *integerstring
Port
Port of the Weaviate HTTP endpoint, typically 443 for https and 80 or 8080 for http. No default: this property is required.
avoidDups booleanstring
Avoid duplicates
If true, each object ID is derived from a hash of its text segment, so re-ingesting the same text overwrites the existing object instead of duplicating it. If false, a random ID is assigned. Defaults to true.
consistencyLevel string
ONEQUORUMALLConsistency level
Write consistency applied to each object: ONE, QUORUM or ALL. Defaults to QUORUM.
grpcPort integerstring
gRPC port
Port of the Weaviate gRPC endpoint. Required when useGrpcForInserts is true. Not set by default.
metadataFieldName string
Metadata field name
Property used to store document metadata on the object. Not set by default, in which case the Weaviate client's own default field name applies.
metadataKeys array
Metadata keys
Metadata keys to persist alongside each object. Defaults to an empty list, meaning no metadata is stored.
scheme string
Scheme
Protocol used to reach the cluster: https (recommended) or http. Defaults to https.
securedGrpc booleanstring
Secure gRPC
Whether the gRPC connection uses TLS. Defaults to true. Only relevant when useGrpcForInserts is true.
useGrpcForInserts booleanstring
Use gRPC for batch inserts
If true, batch inserts go over gRPC, which is faster for large ingestions; searches still use HTTP. Requires grpcPort. Defaults to false.
