Principal Engineer, Data Platform

This is a fully remote position, open to applicants in United States.

📋 Description

• Assist in establishing the architecture and strategic roadmap for the Data Platform and its storage ecosystem.

• Create capabilities for extensive data migrations across various cells, regions, and geographical locations.

• Develop tools to efficiently move, split, validate, and revert data with minimal service interruption.

• Empower product teams to provision, manage, and scale their own storage using self-service tools.

• Lead changes to the data layer for cell-based architecture, encompassing data placement, tenant routing, replication, and isolation.

• Define and implement a managed-first approach to data services.

• Identify and address scalability issues in data stores across different regions, cells, and deployment models.

• Create shared libraries that offer self-service storage functionalities.

• Collaborate closely with Cloud Platform, SRE, and DevEx teams.

• Elevate the architectural standards and mentor Staff and Senior engineers.

• Utilize AI tools for data platform tasks, including slow query analysis and incident investigation.

⛳️ Requirements

• Extensive hands-on experience in designing and managing data platforms and storage systems.

• Proven large-scale production experience with storage technologies such as MongoDB, ClickHouse, Redis, and PostgreSQL.

• Experience with cloud-native data storage, particularly managed data services on AWS.

• Strong knowledge of Kubernetes and containerization technologies.

• Established track record of designing and executing large-scale data migrations, including live migrations.

• Familiarity with cell-based, multi-tenant, or multi-region architectures.

• Experience in building platforms and tools utilized by fellow engineers.

• Comfortable with engineers taking ownership of their storage and managing what they create.

• Proven ability to implement significant changes in code managed by other teams.

• History of identifying data scalability and reliability challenges before they lead to incidents.

• Strong desire and capability to design, guide, influence, and execute ambitious technical roadmaps.

• Experience operating storage systems on Kubernetes is a plus.

• Experience developing control planes with Crossplane is a plus.

• Familiarity with private, isolated, on-premises, or air-gapped deployments is a plus.

🏝️ Benefits

• Performance-based bonus.

• Equity opportunities.

• Comprehensive benefits program.

• Commitment to equal-opportunity employment.

• Reasonable accommodations for qualified employees with protected disabilities.