Google Cloud LogExporter

Google Cloud LogExporter

Certified
Enterprise Edition

Write logs to Google Cloud Storage

Streams Kestra log records into GCS objects in JSON or ION, splitting files after a configurable line count (default 100,000) and buffering writes in chunks (default 1000). Uses service account credentials or impersonation; requires bucket write permission and emits request/file/log metrics.

yaml
type: io.kestra.plugin.ee.gcp.gcs.LogExporter

Ship logs to GCP

yaml
id: log_shipper
namespace: company.team

triggers:
  - id: daily
    type: io.kestra.plugin.core.trigger.Schedule
    cron: "@daily"

tasks:
  - id: log_export
    type: io.kestra.plugin.ee.core.log.LogShipper
    logLevelFilter: INFO
    lookbackPeriod: P1D
    logExporters:
      - id: GCPLogExporter
        type: io.kestra.plugin.ee.gcp.gcs.LogExporter
        projectId: myProjectId
        format: JSON
        maxLinesPerFile:10000
        bucket: my-bucket
        logFilePrefix: kestra-log-file
        chunk: 1000
Properties

Target GCS bucket

Existing bucket receiving the log objects; caller must have write access.

Validation RegExp^[a-zA-Z0-9][a-zA-Z0-9_-]*
Min length1
Default1000

Batch size per upload request

Number of log lines buffered before writing to GCS; defaults to 1000. Lower to reduce memory or request payload.

DefaultJSON
Possible Values
IONJSON

File serialization format

Choose JSON or ION output; defaults to JSON.

The GCP service account to impersonate

Service account email to impersonate for API calls. For Cloud Run runner, this value applies to API calls used to create and run the job (--impersonate-service-account equivalent). It does not set the job execution identity (--service-account).

Defaultkestra-log-file

Log object name prefix

Prefix applied to each object name; final name is prefix-<timestamp>.json|ion. Defaults to kestra-log-file.

Default100000

Maximum lines per file

Rotates to a new object after this many log lines; defaults to 100,000.

The GCP project ID

SubTypestring
Default["https://www.googleapis.com/auth/cloud-platform"]

The GCP scopes to be used

The GCP service account key

Service account JSON key used to authenticate API calls. For Cloud Run runner job execution identity, this value is used as a fallback for --service-account when runtimeServiceAccount is not provided.

Number of files

Number of logs

Number of requests

Duration of requests

More Plugins in this Category

Core Plugins and tasks
Core Plugins and tasks

Tasks that provide Kestra's built-in orchestration, I/O, and observability capabilities.

Core

122 tasks

398 blueprints

Liquibase
Liquibase

Tasks that run Liquibase change management commands.

Data

2 tasks