Principal Data Platform Engineer

This is a fully remote position, open to applicants in United Kingdom, +2 more countries.

📋 Description

• Design and implement a scalable, secure data platform on GCP for analytics and AI throughout RWS.

• Develop reusable, modular Terraform infrastructure-as-code for consistent environment and data-product provisioning.

• Set up CI/CD pipelines for automated, regulated, and traceable infrastructure and data-code deployments.

• Create and construct data pipelines utilizing BigQuery, Dataflow, Dataform, Cloud Composer, and Knowledge Catalog.

• Utilize AI agents and automation to expedite pipeline delivery and enhance engineering-team productivity.

• Take full ownership of the platform, covering everything from infrastructure as code and CI/CD to data pipelines.

⛳️ Requirements

• Proficient in Terraform at an expert level.

• Familiarity with GitHub Actions or comparable automated build and deployment tools.

• Extensive experience with GCP, including BigQuery, Dataflow, Dataform, Cloud Composer, and Pub/Sub.

• Strong understanding of IAM, RBAC, VPC design, and firewall configuration.

• Excellent programming skills in Python.

• Experience with Java or Scala is preferred.

• Comprehensive ELT/ETL design experience.

• Practical experience with Apache Spark.

• Experience with Azure in addition to GCP is advantageous.

• Familiarity with Helm and Kubernetes is a plus.

• Hands-on experience with AI agents or copilots is an added bonus.

• Knowledge or experience in implementing data products and data mesh principles is a bonus.

🏝️ Benefits

• Commitment to equal employment opportunity and non-discrimination.

• An inclusive work environment.

• Opportunities for career growth and personal development.

• The chance to collaborate with global teams supporting operations worldwide.