Download

yaml
type: "io.kestra.plugin.core.http.Download"

Examples

yaml
id: download
namespace: company.team

tasks:
  - id: extract
    type: io.kestra.plugin.core.http.Download
    uri: https://huggingface.co/datasets/kestra/datasets/raw/main/csv/orders.csv

Properties

uri *string

body string

contentType string

Defaultapplication/json

failOnEmptyResponse booleanstring

Defaulttrue

formData object

headers object

SubTypestring

method string

DefaultGET

options

Default

{
  "followRedirects": "true",
  "allowFailed": "false",
  "defaultCharset": "UTF-8"
}

Definitions

io.kestra.core.http.client.configurations.HttpConfiguration

allowFailedbooleanstring

Defaultfalse

allowedResponseCodesarray

SubTypeinteger

auth

io.kestra.core.http.client.configurations.BasicAuthConfiguration

type*object

passwordstring

usernamestring

io.kestra.core.http.client.configurations.BearerAuthConfiguration

type*object

tokenstring

basicAuthPasswordstring

basicAuthUserstring

connectTimeoutstring

Formatduration

connectionPoolIdleTimeoutstring

Formatduration

defaultCharsetstring

DefaultUTF-8

java.nio.charset.Charset

followRedirectsbooleanstring

Defaulttrue

logLevelstring

Possible Values

ALLTRACEDEBUGINFOWARNERROROFFNOT_SPECIFIED

logsarray

SubTypestring

Possible Values

REQUEST_HEADERSREQUEST_BODYRESPONSE_HEADERSRESPONSE_BODY

maxContentLengthinteger

proxy

io.kestra.core.http.client.configurations.ProxyConfiguration

addressstring

passwordstring

portintegerstring

typestring

DefaultDIRECT

Possible Values

DIRECTHTTPSOCKS

usernamestring

proxyAddressstring

proxyPasswordstring

proxyPortinteger

proxyTypestring

Possible Values

DIRECTHTTPSOCKS

proxyUsernamestring

readIdleTimeoutstring

Formatduration

readTimeoutstring

Formatduration

ssl

io.kestra.core.http.client.configurations.SslOptions

insecureTrustAllCertificatesbooleanstring

timeout

io.kestra.core.http.client.configurations.TimeoutConfiguration

connectTimeoutstring

Formatduration

readIdleTimeoutstring

DefaultPT5M

Formatduration

params object

saveAs string

Outputs

code integer

headers object

SubTypearray

length integer

uri string

Formaturi

Metrics

response.length counter

Extract data, transform it, and load it in parallel to S3 and Postgres — in less than 7 seconds!

Publish Application and System Events to AWS EventBridge for Event-Driven Architectures

Stream JSON and Application Events to AWS Kinesis Data Streams at Scale

Python

Tasks that run Python scripts with optional dependencies.

Script

AWS

AWS plugin for Kestra

AlertingCloudMessagingStorageDatabaseScriptToolTransformation

Bun

Tasks that run Bun scripts.

Script

Download

Create automations with Core Http Download

Extract data, transform it, and load it in parallel to S3 and Postgres — in less than 7 seconds!

Publish Application and System Events to AWS EventBridge for Event-Driven Architectures

Stream JSON and Application Events to AWS Kinesis Data Streams at Scale

More Plugins in this Category

Python

AWS

Bun

1.0.25