Senior Engineer

This is a fully remote position, open to applicants in Canada.

📋 Description

• Design, develop, and maintain scalable data processing applications utilizing Apache and SQL

• Create high-performance ETL and data transformation pipelines with Python and Scala

• Develop and enhance batch and near-real-time data processing workflows

• Work with extensive datasets stored in Parquet, Hive, and distributed storage systems

• Write efficient SQL queries and fine-tune execution plans for optimal performance and scalability

• Design data models, partitioning strategies, and storage layouts to enhance processing efficiency

• Collaborate with Data Engineers, Software Engineers, Data Scientists, and Product Teams to deliver data-driven solutions

• Implement automated testing, monitoring, and deployment processes for data applications

• Ensure data quality, reliability, security, and governance standards are upheld

⛳️ Requirements

• Bachelor’s or master’s degree in computer science, engineering, or a related technical field

• Over 5 years of professional experience in software engineering or data engineering

• Strong practical expertise with Apache, SQL, Python, and Scala

• Experience in developing distributed data processing applications

• Solid understanding of Hadoop ecosystem technologies, including Hive, Parquet, and HDFS

• Experience in creating and optimizing ETL pipelines for processing large-scale datasets

• Strong skills in SQL programming and query optimization

• Familiarity with Linux environments and shell scripting

• Experience utilizing version control systems such as Git

• Preferred: experience with AWS cloud platforms, distributed computing, large-scale data architecture, Airflow orchestration, and data lake/lakehouse environments

🏝️ Benefits

• Paid time off according to employee grade (A-F): Vacation: 12-25 days, based on grade

• Company-paid holidays

• Personal Days

• Sick Leave

• Medical, dental, and vision coverage (or coordination with provincial healthcare in Canada)

• Retirement savings plans (RRSP in Canada)

• Life and disability insurance

• Employee assistance programs

• Other benefits as defined by local policy and eligibility

• Potential variable incentives, bonuses, or commissions, depending on the position and applicable laws