Principal Platform Engineer

This is a fully remote position, open to applicants in Germany.

📋 Description

• Design and manage the Data Platform as the foundation for data ingestion, storage, and operational environments.

• Take responsibility for the architecture and reliability of the platform, covering CDC ingestion through the three-tier data lake to the orchestration platform.

• Implement CDC ingestion using DMS/Lambda into the raw S3 layer.

• Oversee raw schemas and data contracts across 13 domains and approximately 180 schemas.

• Manage the Terraform-provisioned orchestration platform utilizing Step Functions, EventBridge, and Glue across the Raw, Curated, and Aggregated layers.

• Develop and sustain the associated CDC Terraform modules.

• Provision and manage OpenMetadata, including its catalog infrastructure.

• Provision and manage Superset for data queries and visualizations.

• Establish clear code boundaries, implement a merge-blocking contract check, and create an unambiguous incident escalation process.

• Build observability and operational excellence through Datadog, incident response, SLOs, and SLIs.

• Participate in the on-call rotation.

• Implement governance and compliance architecture for retention periods, access controls, classification metadata, and deletion requests.

• Collaborate with Data & AI and the Principal Platform Engineer for Infrastructure.

• Ensure a self-service philosophy, golden paths, and quality standards across platform boundaries.

• Proactively identify trade-offs and risks with stakeholders and senior leadership.

⛳️ Requirements

• Strong hands-on experience with AWS services, including Glue, Athena, Step Functions, EventBridge, Lake Formation, and S3.

• Extensive experience with Terraform, creating and evolving shared modules.

• Practical knowledge of CDC pipelines.

• Familiarity with an Iceberg-based lakehouse architecture, featuring Raw, Curated, and Aggregated layers.

• Understanding of Kafka-based event streaming, including MSK and Glue Schema Registry.

• Experience in incident response, SLOs, and the secure management of a platform.

• Excellent cross-functional communication skills.

• Capability to capture individual requirements in the backlog instead of implementing them ad hoc.

• Ability to advocate for and articulate technical positions to both technical and non-technical stakeholders.

• Confidently communicate with senior leadership.

• Nice to have: Familiarity with dbt (dbt-athena) or Spark/pySpark.

• Nice to have: Experience in establishing an on-call rotation.

• Nice to have: Experience working directly with Legal and Compliance stakeholders.

• Authorization to work and reside permanently in the respective country of residence will be requested in the application form.

🏝️ Benefits

• Permanent employment provides long-term security.

• Flexible working hours.

• Options for mobile working and fully remote contracts.

• Freedom to choose your work hardware.

• Well-structured onboarding with a personal “buddy”.

• Inspiring work environment with dedicated colleagues and a dynamic community.

• Opportunities for personal growth and development.

• Company pension plan.

• Health and wellness programs.

• Regular team events.

• On-call compensation aligned with the arrangements of other teams, starting on day one.