Kestra Plugin Fetch

Kestra Plugin Fetch

Certified

Fetch execution logs to storage

Downloads logs for an execution using optional task filters and minimum level. Defaults to the current execution and level INFO. Stores results as an ION file in internal storage and returns its URI and row count.

yaml
type: io.kestra.plugin.kestra.logs.Fetch
yaml
id: fetch_logs_flow
namespace: company.team

tasks:
  - id: my_task
    type: io.kestra.plugin.scripts.shell.Commands
    commands:
      - echo "Processing data"
      - echo "Task completed"

  - id: fetch_logs
    type: io.kestra.plugin.kestra.logs.Fetch
    level: INFO
    executionId: "{{ execution.id }}"

  - id: log_count
    type: io.kestra.plugin.core.log.Log
    message: "Fetched {{ outputs.fetch_logs.size }} log entries"

Fetch WARN logs for a specific execution and task

yaml
id: kestra_logs_fetch
namespace: company.team

tasks:
  - id: fetch
    type: io.kestra.plugin.kestra.logs.Fetch
    level: WARN
    executionId: "{{ execution.id }}"
    tasksId:
      - "previous_task_id"
Properties

Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.

Definitions
assetFailureBehaviorstring
Possible Values
IGNOREFAILWARN

Asset failure behavior

Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.

enableAutobooleanstring

Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.

inputsarray

The assets consumed as inputs.

id*string
Min length1
typestring
outputs

The assets produced as outputs.

id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*string
Min length1

Custom asset type

descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150

Select API authentication

Use either an API token or HTTP Basic (username/password); do not provide both.

Definitions
apiTokenstring

API token for bearer auth

autobooleanstring
Defaulttrue

Automatically retrieve credentials from Kestra's configuration if available

The default configuration can be configured globally inside the Kestra configuration file:

  • Set kestra.tasks.sdk.authentication.api-token to use an API token
  • Set kestra.tasks.sdk.authentication.username and kestra.tasks.sdk.authentication.password for HTTP basic authentication
  • Set kestra.tasks.sdk.authentication.url to also default the Kestra API endpoint (see kestraUrl above) The Enterprise edition also provides setting a default configuration at the Namespace or Tenant level by an administrator. Set to false to also opt out of the default URL, and to call a Kestra API that requires no authentication when no credentials are set either.
passwordstring

Password for HTTP Basic auth

usernamestring

Username for HTTP Basic auth

Execution id to fetch

Defaults to the current execution ID. Provide namespace and flowId when referencing an execution from another flow.

Execution flow id

Required when fetching a different flow's execution without a fully qualified ID.

Override Kestra API endpoint

URL used for calls to the Kestra API. When null, falls back to the url configured alongside the default SDK authentication (Namespace or Tenant level, Enterprise edition), then renders {{ kestra.url }} from configuration; if still empty, defaults to http://localhost: 8080. Trailing slashes are stripped before use.

DefaultINFO
Possible Values
ERRORWARNINFODEBUGTRACE

Minimum log level

Defaults to INFO; lower levels are excluded.

Execution namespace

Used when targeting another execution; defaults to the current flow namespace.

SubTypestring

Task ids filter

Limit logs to these task ids; empty list fetches all tasks.

Override target tenant

Tenant identifier applied to API calls; defaults to the current execution tenant.

The number of rows fetched

Formaturi

Internal storage URI of stored results

Logs are stored as an Amazon ION file, one record per row.