Staff Data Platform Engineer

This is a fully remote position, open to applicants in Europe.

📋 Description

• Develop the data control plane to manage schemas, lineage, ownership, freshness commitments, quality, and access.

• Create libraries, SDKs, templates, data-specific CI/CD, and a near-real-time framework for launching data products.

• Establish the enforcement layer for data standards, which includes a schema registry, contract validator, CI step, and automated certification.

• Ensure that data products are inherently observable through metrics like freshness, volume, schema conformity, and quality instrumentation.

• Generate monitoring data that includes ownership and lineage metadata to facilitate AI-assisted triage.

• Define the architecture, roadmap, and build-versus-buy strategy for the platform.

• Conduct design reviews, integrate the needs of producer and consumer teams, and maintain a modular platform for contributions.

• Collaborate closely with the Sr. Director of Data Engineering as the inaugural Data Platform engineer.

• Expand the Data Platform team as its responsibilities grow.

⛳️ Requirements

• Developed loosely coupled production services, APIs, and SDKs in Python utilized by various teams.

• Created metadata-driven platforms that integrate with catalogs and automatically verify lineage, contracts, and quality.

• Built observability frameworks that other teams rely on, with the capability to differentiate between signal and noise.

• Proven ability to promote tool adoption through architectural reviews, mentorship, and effective communication.

• Extensive experience with AWS.

• Proficient in Terraform.

• Strong background in Kubernetes.

• Highly preferred: experience transitioning from batch to streaming and understanding cost trade-offs.

• Highly preferred: experience with Spark and Iceberg at scale, as well as Snowflake in a production environment.

• Highly preferred: experience in ad tech or a related field with high-volume event data and multiple consumers.

• Highly preferred: familiarity with tooling and data structures used by AI agents.

• Nice to have: experience in establishing first-generation capabilities for a platform team.

• Nice to have: experience with data cataloging, semantic layers, or governance tooling.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Flexible work hours and remote work options.

• Opportunities for professional development and career advancement.

• Collaborative and innovative work environment.