Senior Data Engineer – Contract

This is a fully remote position, open to applicants in Canada.

📋 Description

• Develop and manage production pipelines within Databricks, encompassing Lakeflow, Jobs, and dbt.

• Process customer files into tables that are prepared for modeling and reporting.

• Spearhead the migration phases from Redshift to Databricks.

• Establish source tables, transition product analytics to the lakehouse, and phase out outdated warehouses.

• Oversee replication and ingestion from production databases utilizing AWS DMS, Databricks Lakeflow Connect, and Fivetran.

• Enforce data residency and handle PII across diverse environments.

• Set data contracts with both internal teams and external ML collaborators.

• Supply product teams with effort assessments and trade-offs, challenging the scope when necessary.

• Monitor the health of pipelines, data quality, and Databricks expenses.

• Engage in Data’s on-call rotation.

• Document runbooks, data lineage, and design decisions.

• Contribute to the advancement of AI practices across the Engineering team.

⛳️ Requirements

• Over 5 years of experience in data engineering, including a minimum of 2 years managing Databricks in a production setting.

• Proficient in Databricks Delta, Jobs, DLT/Lakeflow, and Unity Catalog.

• Strong skills in Python, SQL, and dbt.

• Experience in replicating data from operational databases using CDC or event-driven methods.

• Familiarity with ingesting unstructured or messy files.

• Participation in at least one migration project involving a warehouse or lakehouse.

• Comfortable working with AWS data services.

• Experience with handling PII or regulated data, with a preference for financial services experience.

• A strong curiosity for innovation and new technologies, especially in AI and large language models.

• Practical experience using AI coding agents like Claude Code or similar tools.

• Familiarity with Infrastructure-as-Code tools such as Terraform or DAB.

• Experience with LookML or embedded Looker.

• Experience managing pipelines that support forecasting or machine learning models.

• Ability to work independently and prioritize projects effectively.

• Demonstrated capacity to take initiative, innovate, and lead projects.

🏝️ Benefits

• Cabana Days with flexible time and days off.

• Supportive and adaptable work environment.

• Opportunities for professional development, learning, and career growth.

• Regular one-on-one coaching sessions with your supervisor.

• Consistent connection with a dedicated executive team.

• Comprehensive health and dental benefits, virtual care, and disability top-up starting from day one.

• Access to a virtual mental health and Employee Assistance Program (EAP) platform.

• WealthSimple Group Retirement Savings Plan (GRSP) with matching contributions.

• Annual Wellness Benefit of $1000 per year.

• Flexibility to work remotely from anywhere in Canada.

• Employee stock options available.

• Internet subsidy included in each paycheck.

• Tiki Bucks Incentive Program along with bonuses.

• Competitive salary packages.

• Collaborative on-call rotation with support for system availability and reliability.