Pinecone Upsert

Pinecone Upsert

Certified

Upsert vectors into a Pinecone index

Inserts or updates vectors in a Pinecone index namespace. Provide either an inline vectors list or a from URI pointing to a Kestra ION file. Exactly one of these two must be set.

yaml
type: io.kestra.plugin.pinecone.Upsert

Upsert vectors inline.

yaml
id: pinecone_upsert
namespace: company.team

tasks:
  - id: upsert
    type: io.kestra.plugin.pinecone.Upsert
    apiKey: "{{ secret('PINECONE_API_KEY') }}"
    indexName: my-embeddings
    namespace: my-namespace
    vectors:
      - id: vec1
        values: [0.1, 0.2, 0.3]
        metadata:
          category: news
      - id: vec2
        values: [0.4, 0.5, 0.6]

Upsert vectors from an ION file produced by another task.

yaml
id: pinecone_upsert_from_file
namespace: company.team

tasks:
  - id: generate_vectors
    type: io.kestra.plugin.core.http.Download
    uri: https://raw.githubusercontent.com/your-org/datasets/main/vectors.ion

  - id: upsert
    type: io.kestra.plugin.pinecone.Upsert
    apiKey: "{{ secret('PINECONE_API_KEY') }}"
    indexName: my-embeddings
    namespace: my-namespace
    from: "{{ outputs.generate_vectors.uri }}"
Properties

Pinecone API key

Index name

Name of the Pinecone index to operate on.

Kestra ION file URI containing vectors to upsert

Mutually exclusive with vectors. Each line in the ION file must be a map with id, values, and optionally metadata.

Control-plane host override

Optional URL override for the Pinecone control-plane API. Defaults to https://api.pinecone.io when unset. Set this to point to a local emulator (e.g. http://localhost: 5080).

Namespace to write vectors into

Reference (ref) of the pluginDefaults to apply to this task.

Defaulttrue

Enable TLS for gRPC data-plane connections

Set to false when connecting to a local emulator that does not support TLS. Defaults to true (production Pinecone always requires TLS).

SubTypeobject

Inline list of vectors to upsert

Mutually exclusive with from. Each entry must have an id and a values list. Optional fields: metadata (map) and sparseValues.

Default0

Number of vectors successfully upserted

More Plugins in this Category

Liquibase
Liquibase

Tasks that run Liquibase change management commands.

Data

2 tasks

6 blueprints

PostgreSQL
PostgreSQL

Tasks that connect to PostgreSQL via JDBC to run queries and loads.

Data

6 tasks

25 blueprints