
Lead AI Engineer, Platform
Posted 7 hours ago

Posted 7 hours ago
This is a fully remote position, open to applicants in United States.
• Lead the technical initiatives for the ECP Intelligence AI team and take ownership of the team's strategic plan.
• Determine the design, evaluation, and rollout of AI features.
• Collaborate with a senior AI engineer on feature development while reporting to the VP of Engineering for Platform.
• Create AI features integrated into clinical, billing, and CRM products.
• Work alongside product teams and the product manager to establish release quality standards.
• Select models, design retrieval systems and prompts, and manage costs and response times for language-model features.
• Develop summarization, speech-to-text charting, and document intake functionalities using language models.
• Train and implement predictive models for fall risk and change-of-condition detection utilizing tabular and time-series data.
• Construct an MCP server and agents that access ECP data while adhering to user permissions.
• Formulate evaluation plans, real-world test sets, release criteria, and quality monitoring procedures.
• Own and enhance evaluation tools.
• Manage production features, including alerts, feature deactivation, and rollback functionalities.
• Select models capable of processing resident data within AWS and assess when tuning is necessary.
• Decide which models and tools are suitable for handling resident data based on data routing and vendor contract stipulations.
• Mentor fellow engineers and review their designs and code.
• You have successfully delivered features related to language models to paying customers and monitored their performance in production.
• You have authored evaluations for AI features and validated their scoring against human judgment; utilized these evaluations to inform release decisions, including halting at least one change from going live.
• You have trained a predictive model using tabular or time-series data, released it, and assessed its performance against actual outcomes post-launch.
• You have handled sensitive or regulated data within a model and can trace its movement and associated contractual terms.
• You have directed a team's technical efforts without direct management; established a vision, reviewed designs and code, and guided junior engineers.
• Strong software engineering capabilities extending beyond AI, including service and data model design, testing, and being on call for support.
• Familiarity with Node and TypeScript or a comparable technology stack.
• Experience in AI-augmented development, including managing multiple agents or tasks concurrently and setting shared guidelines and review protocols.
• Excellent communication skills, encompassing the ability to write design documents and articulate AI feature capabilities and limitations to product managers, executives, and clients.
• Preferred: Experience in healthcare or time spent observing clinical/frontline personnel.
• Preferred: Development of agents acting on behalf of users with access controls implemented in code.
• Preferred: Experience with an MCP server or similar tools utilized by external agents.
• Preferred: Document extraction using OCR or speech recognition in a production environment.
• Preferred: Familiarity with Amazon Bedrock or self-hosted open models.
• Preferred: Experience with NodeJS, Python, SQL Server, and Databricks.
• Competitive salary and performance-based bonuses.
• Comprehensive health, dental, and vision insurance plans.
• Opportunities for professional development and continued education.
• Flexible work hours and remote working options.
• A collaborative and innovative working environment.
RTX
CSAA Insurance Group, a AAA Insurer
Supabase
Clarity Innovations, Inc.
Get handpicked remote jobs straight to your inbox weekly.