
Senior AI/ML Engineer, LLMs
Posted Aug 25

Posted Aug 25
This is a fully remote position, open to applicants in New York.
• Oversee AI/ML projects from inception and requirements gathering to architecture, development, deployment, and continuous optimization.
• Make strategic architectural and technical choices for scalable, high-performance, reliable, and maintainable AI/ML systems.
• Design, construct, and implement AI-driven and LLM-powered features for the claim synthesis product.
• Extract essential information from intricate medical documents.
• Develop workflows for human-in-the-loop summarization.
• Execute hybrid machine learning solutions utilizing statistical models, LLMs, retrieval-augmented generation (RAG), and embedding-based retrieval.
• Write clean, scalable, and efficient code while optimizing existing production AI/ML systems.
• Collaborate with data labelers and subject matter experts to assess AI outputs and enhance model performance.
• Partner with Product, Engineering, and cross-functional teams to gather requirements, define technical strategies, prioritize tasks, and iterate based on feedback.
• Provide technical leadership and mentorship to engineers while establishing best practices in AI/ML.
• Deconstruct complex, ambiguous issues into technical solutions and propel projects forward.
• Convert cutting-edge AI/ML research and innovative techniques into reliable and maintainable production solutions for live customer environments.
• 5–8+ years of experience crafting high-performance Python code in accordance with modern best practices.
• At least 1 year of experience in building and deploying products powered by large language models (LLMs) in dynamic, professional settings.
• Demonstrated experience leading technical projects from conception to production deployment.
• Experience in making architectural decisions for AI/ML systems and assessing trade-offs regarding scalability, reliability, performance, and maintainability.
• Practical experience with statistical machine learning techniques and hybrid methodologies combining LLMs, retrieval-augmented generation (RAG), and embedding-based models.
• Familiarity with vector search and similarity metrics.
• Proven capability to build and integrate API services within service-oriented or microservice architectures.
• Strong skills in evaluating and interpreting LLM outputs and AI model predictions.
• Expertise in prompt engineering and fine-tuning large language models for specific domain applications.
• Excellent communication and collaboration abilities.
• Experience in transforming cutting-edge AI/ML research into production-ready code.
• Experience working alongside data labelers and subject matter experts to enhance training data and evaluation processes.
• Background in developing agentic or autonomous AI systems in a production environment.
• Experience working with multimodal data, including images and audio.
• Experience mentoring engineers or providing technical leadership across projects or teams.
• Candidates requiring visa transfer must currently reside in the U.S. and possess an active visa eligible for transfer.
• Annual bonus plan.
• Company equity plan (RSUs).
• Medical, dental, and vision insurance.
• Short- and long-term disability insurance.
• Life insurance and AD&D coverage.
• 401(k) matching program.
• Additional family, wellness, and pet benefits.
• Paid time off and sick leave.
• 100% paid parental leave: 16 weeks for primary caregivers and 12 weeks for secondary caregivers.
• Flexible work schedule for new parents returning to their roles.
• Catered lunches.
• Happy hours.
• Pet-friendly workspaces.
• Monthly technology stipend.
• $1,000 per year allocated for professional development.
• Tuition reimbursement.
• Visa sponsorship/transfer consideration for candidates currently in the U.S. with an active visa.
Sourcegraph
Quora
NBCUniversal
Spotify
Get handpicked remote jobs straight to your inbox weekly.