Senior Principal Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Define and enhance the architecture of an enterprise-scale data platform that supports analytical, operational, and AI workloads.

• Create reusable engineering frameworks, reference architectures, and establish technical standards.

• Shape the long-term platform strategy with a focus on scalability, security, performance, and maintainability.

• Lead architecture reviews, technical design, and governance for key engineering initiatives.

• Collaborate with engineering leadership to outline technology roadmaps and promote engineering best practices.

• Influence technical decisions across various teams without direct people management authority.

• Design scalable ETL/ELT frameworks, enterprise data pipelines, and logical and physical data models.

• Develop reusable, metadata-driven frameworks for data integration.

• Set standards for data modeling, metadata management, lineage, and performance optimization.

• Advocate for AI-assisted software development and assess AI coding assistants and productivity tools for engineering.

• Build AI-assisted capabilities such as code generation, automated documentation, code review assistance, test generation, data quality validation, and AI-powered engineering copilots.

• Promote engineering productivity and innovation through the use of Generative AI.

• Provide technical leadership in modern cloud technologies.

• Design secure data platforms that incorporate enterprise governance, metadata, lineage, and RBAC/ABAC access controls.

• Establish best practices in software engineering, covering areas like code quality, testing, automation, observability, and reusable components.

• Mentor senior and principal engineers.

• Collaborate with teams from Product Management, Data Science, Analytics, Data Governance, Enterprise Architecture, and Infrastructure.

• Set the technical direction, establish engineering standards, enhance productivity through automation and AI, and act as a trusted technical advisor.

• Deliver scalable, reliable, and secure enterprise data platforms along with strategic data initiatives.

⛳️ Requirements

• A Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field.

• Over 7 years of experience in Data Engineering, Software Engineering, or Data Platform Engineering.

• Extensive experience in designing enterprise-scale cloud data platforms and architectures.

• Strong proficiency in conceptual, logical, and physical data modeling.

• Expert-level programming skills in Python and SQL.

• Practical experience with Databricks, Azure, AWS, Docker, Kubernetes, Git, REST APIs, and CI/CD.

• A solid understanding of software architecture, design patterns, distributed systems, and secure data platform design.

• Capability to lead complex technical initiatives through influence rather than direct management.

• Excellent communication, stakeholder management, and technical leadership abilities.

• Experience in the pharmaceutical, biotechnology, healthcare, or other regulated industries is preferred.

• Familiarity with Databricks Unity Catalog, enterprise data governance, metadata management, and observability is preferred.

• Experience with Infrastructure as Code tools like Terraform or Bicep is preferred.

• Experience in applying Generative AI to software and data engineering is preferred.

🏝️ Benefits

• Eligibility for an annual bonus plan for Non-Commercial roles.

• Eligibility for an incentive compensation plan for Commercial roles.

• Opportunity for discretionary equity awards.

• Employee Stock Purchase Plan.

• Medical insurance.

• Dental insurance.

• Vision insurance.

• 401(k) plan.

• FSA/HSA options.

• Life insurance.

• Paid Time Off.

• Wellness programs.