Senior Data Engineer, Event Data

This is a fully remote position, open to applicants in Canada.

📋 Description

• Design, construct, and maintain event streaming pipelines that gather data from client systems, internal services, and third-party sources into the data platform.

• Develop and manage analytical databases and data models that are optimized for high-volume event data queries and low-latency access.

• Write production-level Elixir and Python services for the processing, transformation, and routing of events.

• Integrate legacy event pipelines with contemporary streaming infrastructure, creating migration strategies that minimize risk and disruption for downstream consumers.

• Build and sustain monitoring, alerting, and observability tools for event data systems, ensuring pipeline performance, data freshness, and adherence to SLAs.

• Define and uphold event schemas, data contracts, and quality standards in collaboration with both producing and consuming teams.

• Work together with the data platform, product engineering, and analytics teams to comprehend data requirements and deliver dependable event data products.

• Engage in system design reviews and assist in establishing best practices for the Events Data team.

⛳️ Requirements

• Over 6 years of professional experience in data engineering or backend/systems engineering, with a substantial emphasis on event-driven and streaming data systems.

• Strong proficiency in Elixir and/or Python as the primary programming language for developing application connectors, data services, and pipeline components.

• Advanced SQL expertise for data modeling, query optimization, and managing analytical workloads.

• Practical experience with columnar/OLAP (Online Analytical Processing) databases at a production scale.

• Familiarity with stream processing frameworks and message brokers such as Apache Flink, Kafka, Pulsar, or Kinesis; experience with Flink is a significant advantage.

• Demonstrated capability to integrate and migrate systems, connecting legacy and modern architectures.

• Proven success in operationalizing data pipelines, including the development of monitoring, alerting, SLA dashboards, and runbooks for production systems.

• Experience in designing and managing data systems on AWS; GCP experience is a plus.

• Strong collaboration and communication abilities, comfortable leading design discussions, drafting technical specifications, and working across team boundaries.

• Familiarity with Infrastructure-as-Code (IaC) tools such as Terraform, CloudFormation, or similar.

• Experience with retail events data such as clickstream, purchase events, or product interaction data is an added benefit.

🏝️ Benefits

• A comprehensive range of medical, financial, and/or additional benefits.