Gorgias

Gorgias, a company focused on enhancing the user experiences of online merchants and shoppers, has been at the forefront of leveraging technology to achieve its goals. To build and manage its data infrastructure, Gorgias has turned to Infrastructure as Code (IaC) as a key enabler, using an array of modern tools such as Kestra, Airbyte, dbt, and Hightouch.

Technology Stack

Gorgias employs a robust technology stack to manage and automate its data operations:

• Airbyte: Manages data integration from various sources.
• dbt (Data Build Tool): Transforms raw data into analytics-ready models.
• Hightouch: Syncs transformed data back to applications, enabling data-driven operations.
• Kestra: Handles workflow orchestration and ensures data tasks run smoothly.

Addressing Operational Inefficiencies

Before this technological overhaul, Gorgias contended with significant challenges that stemmed from complex orchestration needs, insufficient logging, and rudimentary scheduling capabilities. The limitations of their existing tools, particularly in handling retries, event triggering, and managing dependencies, often led to inefficient workflows and necessitated time-consuming manual interventions.

The Rationale Behind Choosing Kestra

Kestra was identified as the optimal solution for several reasons. Its extensive integrations with critical tools in Gorgias’ technology stack and easy management of data workflows. The platform's user-friendly interface allowed for easy management of tasks and flows, while its YAML-based configuration aligned perfectly with Gorgias' IaC approach, enhancing deployment speed and reliability. Importantly, Kestra's scalability was a key factor, equipped to handle the company's growing number of data workflows.

The Benefits of Kestra

WThe platform enabled efficient orchestration of data syncs and transformations, automating retries and smoothing out the scheduling of tasks. This automation and enhanced control led to a significant reduction in manual workload and a huge increase in automation for their data processes.

Looking Ahead

Gorgias is now poised to expand the capabilities of its data infrastructure further. The focus is on broadening the adoption of Terraform and YAML among the team for defining data workflows, streamlining the CI/CD pipeline for greater efficiency, and exploring the potential of Kestra to replace existing business automation tools. This forward-looking approach allows for a more dynamic, adaptable, and efficient data management ecosystem.

By integrating Kestra into its IaC framework, Gorgias has streamlined its data management practices but also set the stage for ongoing innovation and improvement in how it use data to enhance user experiences.