Principal Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Take charge of the architecture and comprehensive delivery for contemporary data platforms.

• Define client data strategies and create scalable solutions.

• Oversee implementation efforts from the design phase to production.

• Collaborate directly with client stakeholders, from gathering requirements to providing executive updates.

• Guide internal team members and ensure the delivery of high-quality work.

• Balance technology choices while ensuring high-quality outcomes within set deadlines.

• Provide clients with advice on architecture, scalability, and platform progression.

• Facilitate or initiate retrospectives and feedback discussions.

• Record outcomes and advance action items.

• Contribute positively to team dynamics and organizational culture.

• Identify, address, and resolve obstacles hindering team progress.

• Engage in mentoring, leading workshops, representing the tech community, or supporting hiring initiatives.

⛳️ Requirements

• Over 10 years of experience in software development and more than 7 years in data engineering.

• Demonstrated career advancement into technical leadership and architectural responsibilities.

• Profound knowledge of Databricks and modern lakehouse architecture, including Delta Lake and Spark-based processing.

• Advanced skills in SQL and Python for constructing and optimizing large-scale data pipelines.

• Practical experience with cloud platforms, data services, and infrastructure design.

• Familiarity with data modeling, ETL/ELT patterns, and distributed data processing.

• Experience utilizing orchestration tools and transformation frameworks in a production environment.

• Knowledge of healthcare data standards such as Epic, HL7, FHIR, and claims.

• Proficient in CI/CD, DevOps methodologies, and infrastructure-as-code tools.

• Experience in mentoring internal team members is essential.

• Strongly preferred: background in platform engineering; experience with Kafka, Kinesis, or Pub/Sub; exposure to production agentic systems including RAG pipelines and vector search; knowledge of MLOps; and Infrastructure as Code expertise.

🏝️ Benefits

• Unlimited access to thousands of books, courses, and expert-led training on the O'Reilly learning platform.

• Annual financial stipend and designated time for learning & development.

• Support for coworking arrangements for our global team.

• Flexible paid time off (PTO).

• 12 weeks of new parent leave available for eligible employees.