Principal II, AI Platform Engineer – GenAI

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and actively develop GenAI applications for production, including AI agents for members, conversational interfaces, and workflows driven by APIs.

• Create and establish reusable infrastructure for agents, which encompasses orchestration, tool/function invocation, retrieval-augmented generation (RAG), vector searches, context management, and model integrations.

• Architect AI solutions utilizing Databricks, focusing on platform integration, model deployment, retrieval processes, and governance measures.

• Make technical decisions across teams regarding AI architecture, scalability, platform integrations, and the balance between building and purchasing solutions.

• Develop production AI engineering methodologies for evaluation, automated testing, continuous integration/continuous deployment (CI/CD), model/prompt versioning, observability, and troubleshooting.

• Create secure and dependable AI systems incorporating protections for PHI/PII, guardrails, access controls, as well as performance and cost monitoring.

• Collaborate with product, engineering, data, security, and compliance teams to implement AI capabilities for members.

• Provide mentorship to engineers, establish AI engineering standards, and communicate technical directions to engineering leaders and executives.

• Actively engage in on-call support as a senior escalation point for production AI incidents.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Engineering, Machine Learning, or a related discipline, or equivalent practical experience.

• Over 12 years of experience in developing and maintaining production systems.

• Demonstrated success in guiding technical direction for extensive, multi-team projects and defining architectures and standards utilized across the organization.

• More than 5 years of hands-on experience with Databricks at a production level.

• Familiarity with Lakehouse architecture, Unity Catalog, Delta Lake, performance tuning in Spark/PySpark, Workflows, Databricks SQL, and managing costs.

• A strong foundation in traditional machine learning or deep learning techniques.

• Recent and significant experience in agentic GenAI engineering.

• Proven track record of personally building, deploying, and managing production-level GenAI/LLM applications, ideally for over 3 years.

• Extensive knowledge of agent architecture, orchestration, tool invocation, RAG, vector retrieval, context management, evaluation, and observability.

• Proficient Python skills with experience in delivering production AI services or APIs.

• Experience with CI/CD practices, testing, monitoring, and operational troubleshooting.

• Ability to lead through technical expertise, mentor engineers, collaborate across teams, and design secure, reliable systems while remaining actively engaged.

• Applicants must currently have authorization to work in the United States without requiring visa sponsorship now or in the future.

🏝️ Benefits

• Performance bonus.

• RSUs.

• Flexible vacation policy.

• 80 hours of paid sick, safe, and caregiver leave annually.

• Comprehensive benefits program for employees and their families.

• Teladoc Health equipment provided at no cost.

• Opportunities for career advancement.

• An inclusive workplace with equal opportunity employment.