Senior Software Developer, Big Data

This is a fully remote position, open to applicants in Canada.

📋 Description

• Identify and resolve intricate data processing challenges to maintain the reliability and efficiency of essential data pipelines.

• Work collaboratively with the team to ensure timely software releases by proactively addressing data-flow risks and dependencies.

• Mitigate data errors and inconsistencies by enhancing validation, monitoring, and anomaly detection within a complex data landscape.

• Provide additional business value in each development iteration by delivering well-defined improvements and fixes incrementally.

• Quickly familiarize yourself with the current development cycle, adhere to established processes, and collaborate effectively across different time zones as required.

⛳️ Requirements

• Practical experience with Spark, Airflow, AWS, and the Databricks ecosystem is essential.

• Proficient programming and query capabilities in Python and SQL; knowledge of Hive is an advantage.

• In-depth understanding of big data processing principles, including trade-offs, limitations, governance, and performance optimization.

• Demonstrated skills in debugging, unit and integration testing, managing task dependencies, monitoring, and anomaly detection.

• Familiarity with Delta format and comfort in utilizing modern AI tools (e.g., Copilot, ChatGPT) to enhance productivity.

🏝️ Benefits

• Extensive health benefits, life and disability insurance, along with fertility and family-building support programs.

• Generous paid time off, holidays, volunteer leave, quarterly personal wellness days, and meeting-free days.

• Tuition and book reimbursement programs to facilitate continuous learning and professional development.

• Thrive Global wellness program, confidential Employee Assistance Program (EAP), and personalized wellness coaching.

• Employee initiatives — including Employee Resource Groups (ERGs), the “GoTo Gives Back” program, and our charitable donation matching program — to enhance your social network and amplify your impact.

• A registered retirement savings plan to aid in future planning.

• Gym reimbursement programs to promote your physical health.

• Access to telemedicine services for convenient healthcare options.

• A GoTo performance bonus program to acknowledge your contributions.

• A monthly remote work allowance to assist with home office expenses.