Apache Kafka QuotaAlter

Apache Kafka QuotaAlter

Certified

Alter a Kafka client quota

Sets throughput and rate quotas for a user, client-id, ip entity (or a combination of them) using the Kafka AdminClient. Valid on an entity that doesn't have quotas set yet — Kafka creates them on first alteration. At least one quota value must be provided.

yaml
type: io.kestra.plugin.kafka.QuotaAlter

Cap a tenant's produce/consume throughput and controller mutation rate

yaml
id: kafka_quota_alter
namespace: company.team

tasks:
  - id: alter_quota
    type: io.kestra.plugin.kafka.QuotaAlter
    properties:
      bootstrap.servers: localhost:9092
    entityUser: tenant-acme-svc
    producerByteRate: 1048576
    consumerByteRate: 2097152
    controllerMutationRate: 10
Properties

Kafka AdminClient properties

Must include bootstrap.servers; accepts any Kafka AdminClient config. Provide base64-encoded content for ssl.keystore.location and ssl.truststore.location when using SSL.

Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.

Definitions
assetFailureBehaviorstring
Possible Values
IGNOREFAILWARN

Asset failure behavior

Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.

enableAutobooleanstring

Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.

inputsarray

The assets consumed as inputs.

id*string
Min length1
typestring
outputs

The assets produced as outputs.

id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*string
Min length1

Custom asset type

descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
DefaultPT30S

AdminClient call timeout

Maximum duration to wait for each AdminClient operation to complete before failing the task. Defaults to PT30S (30 seconds). Distinct from the task-level timeout, which lets the worker kill the task without retrying it.

Consumer byte rate

Maps to Kafka's consumer_byte_rate quota, in bytes/second.

Controller mutation rate

Maps to Kafka's controller_mutation_rate quota, in mutations/second.

Client ID entity name

IP entity name

User entity name

Producer byte rate

Maps to Kafka's producer_byte_rate quota, in bytes/second.

Request percentage

Maps to Kafka's request_percentage quota, as a percentage of request handler thread time.

SubTypenumber

Quotas that were set

Keys among producer_byte_rate, consumer_byte_rate, request_percentage, controller_mutation_rate.

SubTypestring

Quota entity

Keys among user, client-id, ip.