Senior Data Developer, Niveau 2/Staff

This is a fully remote position, open to applicants in Canada.

📋 Description

• Develop robust and scalable ETL/ELT pipelines on the Databricks platform utilizing Spark, Delta Lake, and Unity Catalog.

• Manage data processing from various sources using dependable and maintainable code.

• Create automated unit, integration, and data quality tests for the pipelines.

• Integrate testing within CI/CD processes and offer technical feedback during code reviews.

• Establish monitoring, alerting, and data quality checks for the production data platform.

• Lead investigations into incidents to identify root causes and derive corrective measures.

• Leverage AI tools to enhance development, testing, and operational workflows.

• Spot opportunities to boost team productivity through AI.

• Share insights with team members and mentor peers in an agile environment.

⛳️ Requirements

• Over 4 years of experience in data engineering or software development.

• Proven hands-on ownership of production data pipelines.

• Practical experience with Databricks or Apache Spark, including Delta Lake and data lake management.

• Strong proficiency in Python and SQL.

• Extensive experience with automated unit and integration testing for pipelines.

• Familiarity with data quality validation.

• Experience working with CI/CD processes.

• Experience managing pipelines in production, including monitoring and alerting.

• Participation in or leadership of incident investigations to identify root causes.

• Effective utilization of AI tools in everyday engineering tasks.

• Excellent communication skills.

• Ability to mentor teammates in an agile setting.

• Knowledge of French is required for permanent roles in Quebec.

• Proficiency in English is necessary.

🏝️ Benefits

• Comprehensive health benefits, including life and disability insurance, and support programs for fertility and family formation.

• Generous paid time off, holidays, volunteer time off, quarterly self-care days, and no meeting days.

• Tuition and reading reimbursement programs.

• Thrive Global Wellness Program.

• Confidential Employee Assistance Program (EAP).

• One-on-One Wellness Coaching.

• Employee Resource Groups (ERGs).

• GoTo Gives program.

• Charitable matching program.

• Registered Retirement Savings Plan (RRSP).

• Gym reimbursement programs.

• Access to telemedicine services.

• GoTo performance bonus program.

• Monthly remote work stipend for home office expenses.

• French-language courses for permanent Quebec employees who need to improve their French proficiency.