RealtimeTrigger RealtimeTrigger

yaml
type: "io.kestra.plugin.kafka.RealtimeTrigger"

Examples

Consume a message from a Kafka topic in real time.

yaml
id: kafka_realtime_trigger
namespace: company.team

tasks:
  - id: log
    type: io.kestra.plugin.core.log.Log
    message: "{{ trigger.value }}"

triggers:
  - id: realtime_trigger
    type: io.kestra.plugin.kafka.RealtimeTrigger
    topic: test_kestra
    properties:
      bootstrap.servers: localhost:9092
    serdeProperties:
      schema.registry.url: http://localhost:8085
      keyDeserializer: STRING
      valueDeserializer: AVRO
    groupId: kafkaConsumerGroupId

Properties

groupId

  • Type: string
  • Dynamic: ✔️
  • Required: ✔️

keyDeserializer

  • Type: string
  • Dynamic: ✔️
  • Required: ✔️
  • Default: STRING
  • Possible Values:
    • STRING
    • INTEGER
    • FLOAT
    • DOUBLE
    • LONG
    • SHORT
    • BYTE_ARRAY
    • BYTE_BUFFER
    • BYTES
    • UUID
    • VOID
    • AVRO
    • JSON

properties

  • Type: object
  • SubType: string
  • Dynamic: ✔️
  • Required: ✔️

valueDeserializer

  • Type: string
  • Dynamic: ✔️
  • Required: ✔️
  • Default: STRING
  • Possible Values:
    • STRING
    • INTEGER
    • FLOAT
    • DOUBLE
    • LONG
    • SHORT
    • BYTE_ARRAY
    • BYTE_BUFFER
    • BYTES
    • UUID
    • VOID
    • AVRO
    • JSON

conditions

  • Type: array
  • SubType: Condition
  • Dynamic:
  • Required:

List of conditions in order to limit the flow trigger.

partitions

  • Type: array
  • SubType: integer
  • Dynamic: ✔️
  • Required:

serdeProperties

  • Type: object
  • SubType: string
  • Dynamic: ✔️
  • Required:
  • Default: {}

since

  • Type: string
  • Dynamic: ✔️
  • Required:

stopAfter

  • Type: array
  • SubType: string
  • Dynamic:
  • Required:

List of execution states after which a trigger should be stopped (a.k.a. disabled).

topic

  • Type: object
  • Dynamic:
  • Required:

topicPattern

  • Type: string
  • Dynamic: ✔️
  • Required:

Outputs

headers

  • Type: array
  • SubType: String_
  • Required:

key

  • Type: object
  • Required:

offset

  • Type: integer
  • Required:

partition

  • Type: integer
  • Required:

timestamp

  • Type: string
  • Required:
  • Format: date-time

topic

  • Type: string
  • Required:

value

  • Type: object
  • Required:

Definitions

org.apache.commons.lang3.tuple.Pair_java.lang.String.java.lang.String_

Was this page helpful?