Curate GCS Files into BigQuery with Python

Orchestrate a GCS to BigQuery pipeline with Kestra. Download an object, clean it with Python and pandas, load the curated result, and notify Discord.

More Cloud Blueprints

Provision AWS EC2 servers and deploy configuration files across all of them at scale with Ansible.

Run a Glue ETL job, validate the output with Athena, then cache the headline KPI in DynamoDB.

Publish inline events and API-sourced JSON to AWS Kinesis Data Streams in bulk, with automatic ION conversion.

Build a Docker image from a GitHub repo and deploy it to local, GCP Cloud Run, or Azure Container Instances from one declarative flow.

Invoke multiple AWS Lambda functions in parallel, target specific versions and aliases, pass custom payloads, and parse the JSON results.

Extract CSV data, mask PII columns with DuckDB SQL, then load the anonymized result into BigQuery.

Trigger an Airbyte Cloud connection sync on a recurring schedule so your data lands fresh without manual runs.

Turn plain-English questions into PostgreSQL queries with OpenAI GPT-4o, grounded on schema only so no row data ever leaves your database.

Ingest Salesforce, Google Analytics, and Facebook Ads in parallel with Airbyte Cloud, then transform with dbt in one orchestrated ELT pipeline.

Incrementally push freshly updated Postgres rows into an Algolia search index every five minutes.

Forecast 7-day demand with OpenAI GPT-4o, auto-generate purchase orders for stockout-risk SKUs, and log them to PostgreSQL every 6 hours.

Turn any PDF, web page, or text document into structured JSON with OpenAI GPT-4o, then store the results in PostgreSQL and Slack.

Use blueprints to kickstart your first workflows.