Senior DataOps Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop, sustain, and operate CI/CD pipelines and infrastructure-as-code for the Smile Digital Health platform and its related services.

• Set up, configure, and manage cloud-based Spark clusters and distributed data processing environments, engaging in hands-on tasks with orchestration tools such as Airflow, Databricks, or EMR.

• Write, test, and uphold data pipelines on the infrastructure you oversee, from environment configuration to production monitoring.

• Design and maintain scalable, secure infrastructure templates along with deployment automation across AWS, Azure, GCP, or OCI environments.

• Investigate and address data pipeline and integration challenges, providing root-cause analysis and sustainable solutions.

• Monitor active systems and pipelines, respond to incidents, optimize performance, and manage costs associated with cloud infrastructure.

• Cultivate an Everything-as-Code culture and advocate for DataOps best practices within the team.

• Support developers and engineers with deployments and builds as required.

⛳️ Requirements

• Over 6 years of experience in a DevOps, DataOps, or data platform engineering capacity.

• Practical experience with Apache Spark and at least one managed Spark platform (Databricks, AWS EMR, GCP Dataproc, or similar).

• Proficient in Python; solid working knowledge of Java or Scala applications.

• Experience with pipeline orchestration tools such as Apache Airflow, Prefect, or comparable technologies.

• Strong CI/CD background with GitLab CI, Jenkins, or GitHub Actions.

• Proficiency in infrastructure-as-code using Terraform, Ansible, or similar tools (AWS CloudFormation and Azure ARM Templates are advantageous).

• Significant experience managing Linux systems and public cloud environments (AWS, Azure, GCP, or OCI).

• Familiarity with Kubernetes or other container orchestration platforms for data workloads.

• Capability to juggle multiple workstreams simultaneously with a keen focus on delivery timelines.

• Customer-oriented mindset with excellent written and verbal communication skills.

🏝️ Benefits

• Remote Work Environment

• Flexible Time Away From Work Policy including PTO, Personal and Sick Days

• Competitive Salary and Health/Medical Benefits

• RRSP/TFSA/401K Employee Contribution

• Life and Disability Coverage

• Employee Assistance Program

• FHIR Study Program and Skillsoft Learning

• Super HAPI Fun Club