Principal Data & AI Platform Engineer, DataOps

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and implement AI and agentic capabilities that enhance data processing reliability, scalability, and operational maturity.

• Establish intelligent pipeline failure detection and recovery mechanisms, incorporating automated retries, root-cause analysis, escalation processes, and user notifications.

• Create AI-driven data quality and heuristic monitoring systems to identify anomalies, evaluate their impact, and suggest or automate optimal next actions.

• Develop and advance large-scale DataOps and platform capabilities to support enterprise data consumers and hundreds of users or more.

• Integrate AI into data engineering operations with a focus on evaluation, observability, human review, and fallback options.

• Collaborate with data engineering, platform, cloud, security, and business/data consumer teams.

• Lead architecture and design evaluations, establishing reusable engineering patterns and standards.

• Actively engage in implementation, troubleshooting, and enhancements in performance and scalability.

• Assess and leverage modern data and AI technologies.

• Mentor engineers while providing technical review and guidance on intricate data platform and AI-enabled engineering challenges.

⛳️ Requirements

• Bachelor's degree in Computer Science, Engineering, or a related discipline; equivalent work experience is considered acceptable.

• Over 10 years of experience in data engineering, software engineering, or platform engineering.

• Senior-level expertise in architecture and large-scale system design.

• At least 3 years of practical experience implementing AI, GenAI, or agentic capabilities in data engineering, platform, or operational workflows.

• Proven experience in architecting or engineering large-scale data processing systems that serve extensive user groups or downstream consumers.

• Experience in productionizing AI-enhanced or agentic solutions, including evaluation, monitoring, failure management, and operational support.

• Strong background with modern data platforms like Databricks or Snowflake and familiarity with large-scale or distributed data processing patterns.

• Capacity to lead technical design and execution across teams, effectively communicate with technical and business stakeholders, and influence outcomes without direct authority.

• Must be authorized to work in the United States without requiring visa sponsorship now or in the future.

• Willingness to travel up to 10%.

• Bonus: Familiarity with Databricks Agent Bricks, LangChain, Hugging Face, or similar technologies.

• Bonus: Experience with context layers, semantic layers, model evaluation, or enterprise AI usability patterns.

• Bonus: Extensive experience in data quality, data observability, lineage, fault tolerance, or automated remediation at scale.

• Bonus: Background in healthcare or another regulated industry.

🏝️ Benefits

• Performance bonus.

• Flexible Vacation Policy.

• 80 hours of Paid Sick, Safe, and Caregiver Leave each year.

• Benefits program focused on employees and their families.

• Significant career advancement opportunities.

• Inclusive workplace culture.