Pinecone Upsert
CertifiedUpsert vectors into a Pinecone index
Pinecone Upsert
Upsert vectors into a Pinecone index
Inserts or updates vectors in a Pinecone index namespace.
Provide either an inline vectors list or a from URI pointing to a Kestra ION file.
Exactly one of these two must be set.
type: io.kestra.plugin.pinecone.UpsertExamples
Upsert vectors inline.
id: pinecone_upsert
namespace: company.team
tasks:
- id: upsert
type: io.kestra.plugin.pinecone.Upsert
apiKey: "{{ secret('PINECONE_API_KEY') }}"
indexName: my-embeddings
namespace: my-namespace
vectors:
- id: vec1
values: [0.1, 0.2, 0.3]
metadata:
category: news
- id: vec2
values: [0.4, 0.5, 0.6]
Upsert vectors from an ION file produced by another task.
id: pinecone_upsert_from_file
namespace: company.team
tasks:
- id: generate_vectors
type: io.kestra.plugin.core.http.Download
uri: https://raw.githubusercontent.com/your-org/datasets/main/vectors.ion
- id: upsert
type: io.kestra.plugin.pinecone.Upsert
apiKey: "{{ secret('PINECONE_API_KEY') }}"
indexName: my-embeddings
namespace: my-namespace
from: "{{ outputs.generate_vectors.uri }}"
Properties
apiKey *string
Pinecone API key
indexName *string
Index name
Name of the Pinecone index to operate on.
assets
Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.
io.kestra.core.models.assets.AssetsDeclaration
IGNOREFAILWARNAsset failure behavior
Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.
Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.
The assets consumed as inputs.
io.kestra.core.models.assets.AssetIdentifier
1The assets produced as outputs.
io.kestra.plugin.ee.assets.Dataset
1150{}1150io.kestra.plugin.ee.assets.File
1150{}1150io.kestra.plugin.ee.assets.Table
1150{}1150io.kestra.plugin.ee.assets.VM
1150{}1150io.kestra.core.models.assets.External
1150{}1150io.kestra.core.models.assets.Custom
11501Custom asset type
{}1150from string
Kestra ION file URI containing vectors to upsert
Mutually exclusive with vectors. Each line in the ION file must be a map with id, values, and optionally metadata.
host string
Control-plane host override
Optional URL override for the Pinecone control-plane API. Defaults to https://api.pinecone.io when unset. Set this to point to a local emulator (e.g. http://localhost: 5080).
namespace string
Namespace to write vectors into
tlsEnabled booleanstring
trueEnable TLS for gRPC data-plane connections
Set to false when connecting to a local emulator that does not support TLS. Defaults to true (production Pinecone always requires TLS).
vectors array
Inline list of vectors to upsert
Mutually exclusive with from. Each entry must have an id and a values list. Optional fields: metadata (map) and sparseValues.
Outputs
upsertedCount integer
0Number of vectors successfully upserted
