Download

yaml
type: "io.kestra.plugin.core.http.Download"

Examples

yaml
id: download
namespace: company.team

tasks:
  - id: extract
    type: io.kestra.plugin.core.http.Download
    uri: https://huggingface.co/datasets/kestra/datasets/raw/main/csv/orders.csv

Properties

uri*string

bodystring

contentTypestring

Defaultapplication/json

failOnEmptyResponsebooleanstring

Defaulttrue

formDataobject

headersobject

SubTypestring

methodstring

DefaultGET

options

Default

{
  "followRedirects": "true",
  "allowFailed": "false",
  "defaultCharset": "UTF-8"
}

Definitions

io.kestra.core.http.client.configurations.HttpConfiguration

allowFailedbooleanstring

Defaultfalse

allowedResponseCodesarray

SubTypeinteger

auth

io.kestra.core.http.client.configurations.BasicAuthConfiguration

type*object

passwordstring

usernamestring

io.kestra.core.http.client.configurations.BearerAuthConfiguration

type*object

tokenstring

basicAuthPasswordstring

basicAuthUserstring

connectTimeoutstring

Formatduration

connectionPoolIdleTimeoutstring

Formatduration

defaultCharsetstring

DefaultUTF-8

java.nio.charset.Charset

followRedirectsbooleanstring

Defaulttrue

logLevelstring

Possible Values

ALLTRACEDEBUGINFOWARNERROROFFNOT_SPECIFIED

logsarray

SubTypestring

Possible Values

REQUEST_HEADERSREQUEST_BODYRESPONSE_HEADERSRESPONSE_BODY

maxContentLengthinteger

proxy

io.kestra.core.http.client.configurations.ProxyConfiguration

addressstring

passwordstring

portintegerstring

typestring

DefaultDIRECT

Possible Values

DIRECTHTTPSOCKS

usernamestring

proxyAddressstring

proxyPasswordstring

proxyPortinteger

proxyTypestring

Possible Values

DIRECTHTTPSOCKS

proxyUsernamestring

readIdleTimeoutstring

Formatduration

readTimeoutstring

Formatduration

ssl

io.kestra.core.http.client.configurations.SslOptions

insecureTrustAllCertificatesbooleanstring

timeout

io.kestra.core.http.client.configurations.TimeoutConfiguration

connectTimeoutstring

Formatduration

readIdleTimeoutstring

DefaultPT5M

Formatduration

paramsobject

saveAsstring

Outputs

codeinteger

headersobject

SubTypearray

lengthinteger

uristring

Formaturi

Metrics

response.lengthcounter

Extract data, transform it, and load it in parallel to S3 and Postgres — in less than 7 seconds!

Publish Application and System Events to AWS EventBridge for Event-Driven Architectures

Stream JSON and Application Events to AWS Kinesis Data Streams at Scale

Core Plugins and tasks

Tasks that provide Kestra's built-in orchestration, I/O, and observability capabilities.

CoreStorageScript

PostgreSQL

Tasks that connect to PostgreSQL via JDBC to run queries and loads.

Database

SurrealDB

Tasks that run SurrealQL queries against SurrealDB.

Database

Download

Create automations with Core Http Download

Extract data, transform it, and load it in parallel to S3 and Postgres — in less than 7 seconds!

Publish Application and System Events to AWS EventBridge for Event-Driven Architectures

Stream JSON and Application Events to AWS Kinesis Data Streams at Scale

More Plugins in this Category

Core Plugins and tasks

PostgreSQL

SurrealDB

0.23.26