AI LocalAI

AI LocalAI
Certified
Use LocalAI OpenAI-compatible server

Targets a self-hosted LocalAI instance via its OpenAI-compatible API for chat/embeddings/images. Set baseUrl if your server is not on the default.

yaml
type: io.kestra.plugin.ai.provider.LocalAI

Examples

Chat completion with LocalAI

yaml
id: chat_completion
namespace: company.ai

inputs:
  - id: prompt
    type: STRING

tasks:
  - id: chat_completion
    type: io.kestra.plugin.ai.completion.ChatCompletion
    provider:
      type: io.kestra.plugin.ai.provider.LocalAI
      modelName: gemma-3-1b-it
      baseUrl: http://localhost:8080/v1
    messages:
      - type: SYSTEM
        content: You are a helpful assistant, answer concisely, avoid overly casual language or unnecessary verbosity.
      - type: USER
        content: "{{ inputs.prompt }}"

Properties

baseUrl *string

API base URL

Base URL of the LocalAI server's OpenAI-compatible API. No default: this property is required.

caPem string

CA PEM certificate content

PEM-encoded certificate authority chain, as text, used to verify the TLS certificate presented by a custom endpoint. Not set by default, in which case the JVM's default trust store is used.

clientPem string

Client PEM certificate content

PEM-encoded client certificate and private key, as text, used for mutual-TLS authentication against enterprise AI endpoints. Not set by default, in which case the default HTTP client is used.

modelName string

Model name

Azure

Leverage Microsoft Azure services within Kestra data workflows.

AICloudDataInfrastructure

TypeSafe

Evaluate content with TypeSafe AI's System One models.

AIData

AI LocalAICertifiedUse LocalAI OpenAI-compatible server

More Plugins in this Category

Azure

TypeSafe

AI LocalAI
Certified
Use LocalAI OpenAI-compatible server