Apache Iggy Produce
CertifiedPublish messages to Apache Iggy stream and topic
Apache Iggy Produce
Publish messages to Apache Iggy stream and topic
Publishes one or more messages to an Apache Iggy stream and topic using data provided via from. Designed for UTF-8 text and JSON payloads; arbitrary binary payloads are not supported. Missing streams and topics are not created automatically unless createIfMissing: true is configured.
type: io.kestra.plugin.iggy.ProduceExamples
Produce messages to an Apache Iggy topic using username and password authentication
id: iggy_produce
namespace: company.team
tasks:
- id: produce
type: io.kestra.plugin.iggy.Produce
host: iggy.example.com
port: 8090
username: "{{ secret('IGGY_USERNAME') }}"
password: "{{ secret('IGGY_PASSWORD') }}"
stream: orders
topic: created
createIfMissing: true
from:
- payload: '{"orderId": 1, "total": 42.5}'
- payload: '{"orderId": 2, "total": 13.0}'
Produce messages from an internal storage file to an Apache Iggy topic
id: iggy_produce_from_file
namespace: company.team
tasks:
- id: produce
type: io.kestra.plugin.iggy.Produce
host: iggy.example.com
port: 8090
username: "{{ secret('IGGY_USERNAME') }}"
password: "{{ secret('IGGY_PASSWORD') }}"
stream: orders
topic: created
createIfMissing: true
from: "{{ outputs.some_task_with_output_file.uri }}"
Properties
from *stringarrayobject
Structured data items, either as a map, a list of map, a URI, or a JSON string.
Structured data items can be defined in the following ways:
- A single item as a map (a document).
- A list of items as a list of maps (a list of documents).
- A URI, supported schemes are
kestrafor internal storage files,filefor host local files, andnsfilefor namespace files. - A JSON String that will then be serialized either as a single item or a list of items.
Pebble expression referencing an Internal Storage URI e.g. {{ outputs.mytask.uri }}.
host *string
Server host
Hostname or IP address of the Apache Iggy server.
stream *string
Stream identifier or name
Name or ID of the Apache Iggy stream to publish messages to.
topic *string
Topic identifier or name
Name or ID of the Apache Iggy topic to publish messages to.
assets
Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.
io.kestra.core.models.assets.AssetsDeclaration
IGNOREFAILWARNAsset failure behavior
Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.
Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.
The assets consumed as inputs.
io.kestra.core.models.assets.AssetIdentifier
1The assets produced as outputs.
io.kestra.plugin.ee.assets.Dataset
1150{}1150io.kestra.plugin.ee.assets.File
1150{}1150io.kestra.plugin.ee.assets.Table
1150{}1150io.kestra.plugin.ee.assets.VM
1150{}1150io.kestra.core.models.assets.External
1150{}1150io.kestra.core.models.assets.Custom
11501Custom asset type
{}1150createIfMissing booleanstring
falseCreate missing stream and topic
Whether to automatically create the missing stream and topic if they do not exist. Defaults to false.
partitionId integerstring
Partition ID
Optional partition ID to publish to. If omitted, balanced partitioning is used.
password string
Authentication password
Password for authentication.
port integerstring
8090Server port
Port of the Apache Iggy server. Defaults to 8090 for TCP and 3000 for HTTP.
tls booleanstring
falseUse TLS
Whether to enable TLS encryption for the connection. Defaults to false.
token string
Personal access token
Personal access token (PAT) for token-based authentication.
transport string
TCPTCPHTTPTransport protocol
Transport protocol to use: TCP (default) or HTTP.
username string
Authentication username
Username for authentication.
Outputs
messagesCount integer
Messages produced
Total number of messages published during this task execution.
