Principal Data Engineer

This is a fully remote position, open to applicants in New York, +1 more state.

📋 Description

• Lead the architectural design and solutions for the Beacon Datastore in collaboration with engineering, product leaders, and Datastore stakeholders.

• Shape architectural standards across Platform teams.

• Develop features that exemplify best practices.

• Mentor team members and assist in enhancing their skills.

• Uphold high standards for data integrity, design quality, and maintainability.

• Create RFCs to drive complex feature exploration and technical design phases.

• Gather and integrate feedback while fostering consensus on decisions that steer development.

• Work together with product and technical leads from both platform and scientific teams.

• Contribute to defining architectural direction and standards across Platform teams.

⛳️ Requirements

• Over 10 years of backend development experience, with substantial expertise in data engineering, data platforms, and infrastructure for data-driven applications.

• Strong command of SQL.

• Experience in production environments with PostgreSQL.

• Proficient in data streaming and event processing using tools like Kafka, RabbitMQ, Pulsar, Amazon Kinesis, or similar technologies.

• Strong knowledge of a modern general-purpose programming language.

• Willingness and eagerness to quickly learn SQL, TypeScript, and Julia; expertise in Datastore-specific stacks is not mandatory.

• Experience with, or a keen interest in, LLM-assisted or agentic coding tools in production, demonstrating sound judgment regarding necessary guardrails.

• Experience in deploying and managing services within containerized environments.

• Knowledge of Kubernetes.

• Familiarity with Infrastructure as Code tools such as Terraform and/or Helm.

• Collaborative attitude and ability to work across various disciplines.

• Outstanding written and verbal communication skills, particularly in asynchronous and remote-friendly settings.

🏝️ Benefits

• Equity.

• PTO.

• Comprehensive asynchronous work practices.

• Premium remote work experience.

• Access to in-person office hubs located in Boston, New York, and Paris.

• Opportunity to mentor engineers and help them grow their skills.