Consume
CertifiedConsume messages from a Huawei DMS for Kafka topic.
Consume
Certified
Consume messages from a Huawei DMS for Kafka topic.
yaml
type: io.kestra.plugin.huawei.dms.kafka.ConsumeExamples
yaml
id: dms_kafka_consume
namespace: company.team
tasks:
- id: consume
type: io.kestra.plugin.huawei.dms.kafka.Consume
bootstrapServers: "dms-instance-id.kafka.eu-west-101.myhuaweicloud.com:9093"
saslMechanism: PLAIN
username: "{{ secret('DMS_KAFKA_USERNAME') }}"
password: "{{ secret('DMS_KAFKA_PASSWORD') }}"
topic: my-topic
groupId: kestra-consumer-group
maxRecords: 100
valueSerdeType: JSON
Properties
bootstrapServers *Requiredstring
groupId *Requiredstring
topic *Requiredstring
accessKeyId string
domainId string
keySerdeType string
Default
STRINGPossible Values
STRINGJSONBINARYmaxDuration string
maxRecords integerstring
password string
pollDuration string
Default
PT5SprojectId string
region string
saslMechanism string
Default
PLAINPossible Values
PLAINSCRAM_SHA_512NONEsecretAccessKey string
securityToken string
sslEnabled booleanstring
Default
falsetemporaryCredentials string
Definitions
io.kestra.plugin.huawei.TemporaryCredentialsConfig
authMethodstring
Default
PASSWORDPossible Values
PASSWORDTOKENdomainNamestring
durationSecondsintegerstring
Default
900endpointSuffixstring
Default
myhuaweicloud.comiamTokenstring
passwordstring
projectNamestring
scopestring
Default
PROJECTPossible Values
PROJECTDOMAINusernamestring
username string
valueSerdeType string
Default
STRINGPossible Values
STRINGJSONBINARYOutputs
messagesCount integer
uri string
Format
uriMetrics
dms.kafka.consume.count counter
Unit
records
