Download icon
Script icon
Docker icon
Load icon
DiscordIncomingWebhook icon
gcp icon
Schedule icon

Curate GCS Files into BigQuery with Python

Orchestrate a GCS to BigQuery pipeline with Kestra. Download an object, clean it with Python and pandas, load the curated result, and notify Discord.

Categories
CloudData

More Cloud Blueprints

Glue ETL, Athena Validation, DynamoDB Cache
StartJobRun icon
Query icon
PutItem icon
SlackIncomingWebhook icon
Schedule icon
CloudData
Stream JSON and Application Events to AWS Kinesis Data Streams at Scale
PutRecords icon
Download icon
JsonToIon icon
Cloud
High-Performance Computing, Run Parallel Python Workloads on AWS Batch with ECS Fargate
WorkingDirectory icon
Clone icon
TerraformCLI icon
Script icon
Docker icon
Parallel icon
+2
CloudCoreInfrastructure

More Data Blueprints

AI Document Data Extraction: Parse PDFs and Web Pages into Structured JSON with OpenAI
Download icon
Script icon
ChatCompletion icon
Queries icon
SlackIncomingWebhook icon
AIData
Build an ETL Pipeline with Airbyte Cloud and dbt Core for SaaS Analytics
Parallel icon
Sync icon
WorkingDirectory icon
Clone icon
Build icon
Docker icon
Data
Build an ETL Pipeline with Parallel Airbyte Syncs and dbt Core Transformations
Parallel icon
Sync icon
WorkingDirectory icon
Clone icon
Build icon
Docker icon
Data
See How

New to Kestra?

Use blueprints to kickstart your first workflows.

Get Started