Consume

Consume
Certified
Consume records from a Huawei Cloud DIS (Data Ingestion Service) stream

yaml
type: io.kestra.plugin.huawei.dis.Consume

Examples

yaml
id: dis_consume
namespace: company.team

tasks:
  - id: consume
    type: io.kestra.plugin.huawei.dis.Consume
    accessKeyId: "{{ secret('HUAWEI_AK') }}"
    secretAccessKey: "{{ secret('HUAWEI_SK') }}"
    region: eu-west-101
    streamName: my-stream
    maxRecords: 500

Properties

streamName *string

accessKeyId string

domainId string

endpointOverride string

endpointSuffix string

maxDuration string

maxFetchBytes integerstring

Default2097152

maxRecords integerstring

partitionId string

pluginDefaultsRef string

projectId string

region string

secretAccessKey string

securityToken string

serdeType string

DefaultSTRING

Possible Values

STRINGJSONBINARY

startingPosition string

DefaultTRIM_HORIZON

Possible Values

TRIM_HORIZONLATESTAT_TIMESTAMP

startingTimestamp string

temporaryCredentials string

Definitions

io.kestra.plugin.huawei.TemporaryCredentialsConfig

authMethodstring

DefaultPASSWORD

Possible Values

PASSWORDTOKEN

domainNamestring

durationSecondsintegerstring

Default900

endpointSuffixstring

Defaultmyhuaweicloud.com

iamTokenstring

passwordstring

projectNamestring

scopestring

DefaultPROJECT

Possible Values

PROJECTDOMAIN

usernamestring

Outputs

count integer

uri string

Formaturi

Metrics

dis.consume.count counter

Unitrecords

NetBox

Enterprise

Enterprise NetBox tasks to create, update, and query devices, IP addresses, and sites over the NetBox API.

Infrastructure

Clickhouse

Tasks that connect to ClickHouse via JDBC to run queries and loads.

Data

ConsumeCertifiedConsume records from a Huawei Cloud DIS (Data Ingestion Service) stream

More Plugins in this Category

NetBox

Clickhouse

Consume
Certified
Consume records from a Huawei Cloud DIS (Data Ingestion Service) stream