GCP Data Engineer

This is a fully remote position, open to applicants in Canada.

📋 Description

• Apply DevOps principles to assess existing and new solutions while offering data engineering assistance to EMR platforms.

• Improve infrastructure and data projects that facilitate real-time health alerts.

• Assist frontline and support teams in swiftly identifying issues to minimize mean time to repair.

• Generate after-action reports to enhance the understanding of service health.

• Lead, motivate, and support team members to foster performance and engagement.

• Collaborate with both internal and external stakeholders, as well as strategic vendor partners.

• Design and deploy solutions for internal clientele.

• Work alongside other teams to comprehend and fulfill requirements.

• Identify and promote automation opportunities across databases and AWS.

• Strive for continuous improvement in processes, reliability, and efficiency.

• Recognize and upgrade operational support tools and network monitoring solutions.

⛳️ Requirements

• Eagerness to learn and develop expertise in new technologies.

• Strong time management skills and the ability to work autonomously as well as collaboratively.

• Proficient in research, analytical thinking, and problem-solving.

• Demonstrate initiative and take ownership of complex issues until resolution.

• Experience with database technologies including Oracle, MySQL, MSSQL, and MongoDB.

• In-depth knowledge of Apache Flink and Apache Kafka for real-time data processing.

• A solid foundation in a single-node Python framework.

• Familiarity with PySpark.

• Proficient in SQL, stored procedures, and data modeling.

• Experience with cloud infrastructure, ideally GCP; familiarity with GCP and/or AWS.

• Some experience with Terraform coding.

• Knowledge of modern big-data storage technologies, such as Iceberg, Hudi, or Delta; Iceberg is preferred.

• Good experience with GCP services including BigQuery, Cloud Storage, Cloud Dataflow, and Dataproc.

• Expertise in data analytics.

• Strong business acumen and customer orientation.

• Advanced proficiency in oral and written English communication skills.

• Preferred: experience in query optimization, resource allocation and management, and data lake performance using Presto and SQL.

• Preferred: familiarity with Jira, Confluence, and Jenkins.

• Preferred: experience with Palantir Foundry.

• Preferred: background in statistics or computational mathematics, including Bayesian and Frequentist methodologies, NumPy, and PyMC3.

• Some experience with AWS database-related services such as DMS, Glue, Athena, and Textract.

• Proficient in Linux RHEL and CentOS scripting.

🏝️ Benefits

• Comprehensive health benefits.

• Opportunities for professional development and growth.

• Flexible work arrangements.

• A collaborative and inclusive work environment.