Data Platform Engineer, GCP

This is a fully remote position, open to applicants in Canada.

📋 Description

• Assist in the support and maintenance of production GCP data platforms, pipelines, and workflows for both batch and streaming workloads.

• Diagnose and enhance Cloud Composer / Apache Airflow workflows, addressing issues such as DAG failures, dependencies, scheduling, retries, latency, and SLA concerns.

• Resolve pipeline failures, data latency, performance issues, configuration errors, and infrastructure challenges.

• Monitor platform health and work to enhance reliability, scalability, performance, and operational efficiency.

• Refine existing pipelines and workloads to boost refresh times, throughput, query performance, and platform stability.

• Assist with platform, infrastructure, configuration, and dependency upgrades, ensuring production stability and compliance are maintained.

• Conduct root-cause analysis and implement sustainable solutions for recurring production challenges.

• Support IAM, access controls, monitoring, alerting, logging, and operational governance initiatives.

• Collaborate with clients and cross-functional teams, including Data Engineering, BI/Analytics, Application Engineering, Infrastructure, and Platform teams.

• Evaluate current architectures and suggest incremental enhancements.

• Develop and maintain technical documentation, operational runbooks, troubleshooting guides, and platform support procedures.

⛳️ Requirements

• 3–7 years of experience in Data Engineering, Cloud Engineering, Platform Engineering, or a similar role.

• Extensive hands-on experience in building, supporting, or maintaining production workloads on Google Cloud Platform.

• Strong proficiency with BigQuery and Cloud Spanner.

• Practical experience with Dataflow, Pub/Sub, batch/streaming data pipelines, and Cloud Composer / Apache Airflow.

• Proficient in Python and SQL.

• Familiarity with GCP IAM, service accounts, permissions, monitoring, logging, alerting, and production operations.

• Experience in troubleshooting complex production environments and conducting root-cause analysis.

• Knowledge of data ingestion, transformation, orchestration, data quality, performance optimization, and reliability.

• Ability to comprehend existing systems, codebases, pipelines, configurations, and client-specific tools and workflows.

• Excellent communication and collaboration skills.

• Preferred: Experience with App Engine, Cloud Run, GKE, CI/CD and DevOps on GCP, Terraform, data observability, automated data-quality monitoring, Vertex AI, and enterprise analytics tools.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Flexible work hours and remote work options.

• Opportunities for professional development and training.

• Collaborative and inclusive work environment.