AWS

AWS plugin for Kestra

Authentication

All tasks must be authenticated for the AWS Platform. You can either set up the credentials using the DefaultCredentialsProvider or explicitly set credentials using secrets or environment variables.

The DefaultCredentialsProvider is an AWS credentials provider chain that looks for credentials in this order:

• Java System Properties - Java system properties with variables aws.accessKeyId and aws.secretAccessKey. You can explicitly define those values for a given AWS task and reference secrets when using them. Check the blueprints such as this one, showing how you can reference secrets in your AWS tasks.
• Environment Variables - AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY.
• Web Identity Token credentials from system properties or environment variables.
• Credential profiles file in the default location (~/.aws/credentials) shared by all AWS SDKs and the AWS CLI.
• Credentials provided by the Amazon EC2 container service if the AWS_CONTAINER_CREDENTIALS_RELATIVE_URI environment variable is set and the security manager has permission to access the variable.
• Instance profile credentials provided by the Amazon EC2 metadata service.

Sqs

This sub-group of plugins contains tasks for using Amazon Simple Queue Service (SQS). Amazon SQS is a fully managed message queuing for microservices, distributed systems, and serverless applications.

Triggers

• Trigger

Tasks

• Consume
• Publish

Sns

This sub-group of plugins contains tasks for using Amazon Simple Notification Service (SNS) . Amazon SNS is a fully managed Pub/Sub service for A2A and A2P messaging.

Tasks

• Publish

Eventbridge

This sub-group of plugins contains tasks for using Amazon EventBridge. Amazon EventBridge is a serverless event bus that ingests data from your own apps, SaaS apps, and AWS services and routes that data to targets.

Tasks

• PutEvents

Dynamodb

This sub-group of plugins contains tasks for using Amazon DynamoDB. Amazon DynamoDB is a fully managed, serverless, key-value NoSQL database designed to run high-performance applications at any scale.

Tasks

• DeleteItem
• GetItem
• PutItem
• Query
• Scan

Kinesis

This sub-group of plugins contains tasks for using Amazon Kinesis. Amazon Kinesis is a family of services provided by Amazon Web Services (AWS) for processing and analyzing real-time streaming data at a large scale.

Tasks

• PutRecords

Runner

Task Runners

• AwsBatchTaskRunner

Lambda

This sub-group of plugins contains tasks for using Amazon Lambda. AWS Lambda is a serverless, event-driven compute service that lets you run code for virtually any type of application or backend service without provisioning or managing servers.

Tasks

• Invoke

Athena

This sub-group of plugins contains tasks for using Amazon Athena.Amazon Athena is an interactive query service that makes it easy to analyze data in Amazon S3 and other federated data sources using standard SQL.

Tasks

• Query

Cli

Tasks

• AwsCLI

S3

This sub-group of plugins contains tasks for using Amazon Simple Storage Service (S3). Amazon S3 is an object storage built to retrieve any amount of data from anywhere.

Triggers

• Trigger

Tasks

• Copy
• CreateBucket
• Delete
• DeleteList
• Download
• Downloads
• List
• Upload

Task Runners

• DockerTaskRunner

Ecr

This sub-group of plugins contains tasks to interact with Amazon ECR.

Tasks

• GetAuthToken