
Senior Engineer
Posted 2 days ago

Posted 2 days ago
This is a fully remote position, open to applicants in Canada.
• Design, develop, and maintain scalable applications for data processing utilizing Apache and SQL.
• Construct high-performance ETL and data transformation pipelines with Python and Scala.
• Create and enhance both batch and near-real-time data processing workflows.
• Manage large-scale datasets stored in Parquet, Hive, and various distributed storage systems.
• Compose efficient SQL queries and enhance execution plans for improved performance and scalability.
• Design data models, partitioning strategies, and storage configurations.
• Collaborate effectively with Data Engineers, Software Engineers, Data Scientists, and Product Teams.
• Implement automated testing, monitoring, and deployment procedures for data applications.
• Ensure that standards for data quality, reliability, security, and governance are upheld.
• Bachelor’s or master’s degree in computer science, Engineering, or a related technical discipline.
• Over 5 years of professional experience in software engineering or data engineering.
• Extensive hands-on experience with Apache, SQL, Python, and Scala.
• Proven experience in building distributed data processing applications.
• In-depth knowledge of Hadoop ecosystem technologies, including Hive, Parquet, and HDFS.
• Experience in developing and optimizing ETL pipelines for large-scale datasets.
• Strong skills in SQL programming and query optimization.
• Familiarity with Linux environments and shell scripting.
• Experience with version control systems such as Git.
• Preferred: experience with AWS cloud platforms, distributed computing, large-scale data architecture, Airflow orchestration, and data lake/lakehouse environments.
• Vacation: 12-25 days, depending on grade.
• Company-paid holidays.
• Personal Days.
• Sick Leave.
• Medical, dental, and vision coverage (or provincial healthcare coordination in Canada).
• Retirement savings plans (e.g., RRSP in Canada).
• Life and disability insurance.
• Employee assistance programs.
• Other benefits as determined by local policy and eligibility.
• Additional compensation such as variable incentives, bonuses, or commissions may be available.
IQ Plus AG
Clipbook
GFT Technologies
Anyone AI
Get handpicked remote jobs straight to your inbox weekly.