LanceDB TableCreate

LanceDB TableCreate

Certified

Create a table in LanceDB

Initializes a new vector table in LanceDB with the specified vector dimension and distance metric.

yaml
type: io.kestra.plugin.lancedb.TableCreate

Create a LanceDB table with 1536 dimensions and Cosine distance in S3

yaml
id: lancedb_table_create
namespace: company.team

tasks:
  - id: create_table
    type: io.kestra.plugin.lancedb.TableCreate
    uri: "s3://my-bucket/lancedb"
    table: documents
    dimension: 1536
    distanceMetric: COSINE
    storageOptions:
      aws_access_key_id: "{{ secret('AWS_ACCESS_KEY_ID') }}"
      aws_secret_access_key: "{{ secret('AWS_SECRET_ACCESS_KEY') }}"
      region: "us-east-1"

Create a table in local directory with L2 distance

yaml
id: lancedb_local_table
namespace: company.team

tasks:
  - id: create_table
    type: io.kestra.plugin.lancedb.TableCreate
    uri: "/tmp/lancedb"
    table: embeddings
    dimension: 384
    distanceMetric: L2
    overwrite: true
Properties

Vector dimension

The dimension size of vectors to be stored in the table (1 to 65536, e.g. 1536 for OpenAI embeddings, 384 for MiniLM).

Table name

The name of the LanceDB table to create.

Database URI

Path or URI to the LanceDB database directory or endpoint, e.g. local directory '/tmp/lancedb', cloud object store 's3://my-bucket/lancedb', 'gs://my-bucket/lancedb', 'az://my-bucket/lancedb'.

Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.

Definitions
assetFailureBehaviorstring
Possible Values
IGNOREFAILWARN

Asset failure behavior

Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.

enableAutobooleanstring

Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.

inputsarray

The assets consumed as inputs.

id*string
Min length1
typestring
outputs

The assets produced as outputs.

id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*string
Min length1

Custom asset type

descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
DefaultCOSINE
Possible Values
COSINEL2DOT

Distance metric

Distance metric for vector comparisons: COSINE (cosine distance, recommended for normalized embeddings), L2 (squared Euclidean distance), or DOT (dot product distance). Default is COSINE.

Defaultfalse

Overwrite table if it already exists

Whether to overwrite the table if it already exists (default: false).

Storage options

Key-value configuration options for cloud object storage (e.g. AWS access key, secret key, region, endpoint URL).

Created status

Whether a new table was created (false if already existed and overwrite was false).

Vector dimension

The dimension size of the vectors.

Possible Values
COSINEL2DOT

Distance metric

The distance metric configured on the table.

Table name

The name of the table that was created.