Query

Query

Certified

Run a SQL query on Huawei Cloud DLI (Data Lake Insight)

yaml
type: io.kestra.plugin.huawei.dli.Query
yaml
id: dli_query_store
namespace: company.team

tasks:
  - id: query
    type: io.kestra.plugin.huawei.dli.Query
    accessKeyId: "{{ secret('HUAWEI_AK') }}"
    secretAccessKey: "{{ secret('HUAWEI_SK') }}"
    region: eu-west-101
    sql: "SELECT * FROM my_database.my_table WHERE event_date = '2024-01-01'"
    database: my_database
    queue: my_queue
    outputLocation: "obs://my-bucket/dli-results/"

yaml
id: dli_query_fetch_one
namespace: company.team

tasks:
  - id: query
    type: io.kestra.plugin.huawei.dli.Query
    accessKeyId: "{{ secret('HUAWEI_AK') }}"
    secretAccessKey: "{{ secret('HUAWEI_SK') }}"
    region: eu-west-101
    sql: "SELECT COUNT(*) AS total FROM my_database.my_table"
    database: my_database
    queue: my_queue
    fetchType: FETCH_ONE

yaml
id: dli_query_ddl
namespace: company.team

tasks:
  - id: create_table
    type: io.kestra.plugin.huawei.dli.Query
    accessKeyId: "{{ secret('HUAWEI_AK') }}"
    secretAccessKey: "{{ secret('HUAWEI_SK') }}"
    region: eu-west-101
    sql: "CREATE TABLE IF NOT EXISTS my_database.my_table (id INT, name STRING)"
    database: my_database
    queue: my_queue
    fetchType: NONE

yaml
id: dli_query_eu_sovereign
namespace: company.team

tasks:
  - id: query
    type: io.kestra.plugin.huawei.dli.Query
    accessKeyId: "{{ secret('HUAWEI_AK') }}"
    secretAccessKey: "{{ secret('HUAWEI_SK') }}"
    region: eu-west-101
    endpointSuffix: myhuaweicloud.eu
    projectId: "{{ secret('HUAWEI_PROJECT_ID') }}"
    sql: "SELECT * FROM my_database.my_table LIMIT 100"
    database: my_database
    queue: my_queue
    fetchType: FETCH
Properties
SubTypestring
DefaultSTORE
Possible Values
STOREFETCHFETCH_ONENONE
DefaultPT5S
DefaultPT1H
DefaultOBS
Possible Values
OBSV2V4
Defaultfalse
Definitions
authMethodstring
DefaultPASSWORD
Possible Values
PASSWORDTOKEN
domainNamestring
durationSecondsintegerstring
Default900
endpointSuffixstring
Defaultmyhuaweicloud.com
iamTokenstring
passwordstring
projectNamestring
scopestring
DefaultPROJECT
Possible Values
PROJECTDOMAIN
usernamestring
SubTypeobject
Formaturi
Unitrows