Senior DataOps Engineer

📋 Description

• Develop, maintain, and operate CI/CD pipelines and infrastructure-as-code for the Smile Digital Health platform and its related services.

• Set up, configure, and manage cloud-based Spark clusters along with distributed data processing environments, including hands-on experience with orchestration tools like Airflow, Databricks, or EMR.

• Create, test, and uphold data pipelines on the infrastructure you oversee, from the initial environment setup to production monitoring.

• Design and sustain scalable, secure infrastructure templates and deployment automation across AWS, Azure, GCP, or OCI environments.

• Analyze and troubleshoot data pipeline and integration challenges, delivering root-cause analysis and sustainable solutions.

• Monitor active systems and pipelines, respond to incidents, optimize performance, and manage cloud infrastructure expenses.

• Cultivate an Everything-as-Code culture and advocate for DataOps best practices within the team.

• Support developers and engineers with deployments and builds as necessary.

⛳️ Requirements

• Over 6 years of experience in a DevOps, DataOps, or data platform engineering position.

• Hands-on expertise with Apache Spark and at least one managed Spark platform (Databricks, AWS EMR, GCP Dataproc, or similar).

• Proficient in Python; solid working knowledge of Java or Scala applications.

• Experience with pipeline orchestration tools such as Apache Airflow, Prefect, or comparable solutions.

• Strong CI/CD expertise with GitLab CI, Jenkins, or GitHub Actions.

• Proficiency in infrastructure-as-code using Terraform, Ansible, or equivalent (experience with AWS CloudFormation and Azure ARM Templates is a plus).

• Significant experience operating Linux systems and public cloud environments (AWS, Azure, GCP, or OCI).

• Familiarity with Kubernetes or other container orchestration platforms designed for data workloads.

• Capability to manage multiple workstreams simultaneously with a keen focus on delivery timelines.

• Customer-centric approach with excellent written and verbal communication skills.

🏝️ Benefits

• Remote Work Environment

• Flexible Time Away From Work Policy including PTO, Personal and Sick Days

• Competitive Salary and Health/Medical Benefits

• RRSP/TFSA/401K Employee Contribution

• Life and Disability Insurance

• Employee Assistance Program

• FHIR Study Program and Skillsoft Learning

• Super HAPI Fun Club