
Senior AI Engineer
Posted 3 days ago

Posted 3 days ago
This is a fully remote position, open to applicants in Alabama, +29 more states.
• Oversee LLM-driven products from inception to completion, encompassing prototyping, evaluation, deployment, monitoring, and iteration.
• Take charge of matching, search, and ranking systems, which includes model design, offline validation, shadow scoring, and A/B testing.
• Collaborate with embeddings and ElasticSearch technologies.
• Deploy production code across Python ML services, Rails, and React platforms.
• Identify hallucinations, retrieval misses, and ranking regressions.
• Transform ambiguous queries into data analyses that support product development with a focus on production.
• Perform thorough code reviews in collaboration with ML, AI, and product engineers.
• Successfully manage AI projects from scoping to the launch validated by experiments.
• Maintain production ML services and assist in planning the future AI roadmap.
• A minimum of 6 years of experience in software engineering.
• At least 2 years of recent experience in bringing ML- and LLM-powered features from conception to deployment and long-term maintenance.
• Strong proficiency in Python software engineering.
• Capability to independently execute, validate, and analyze ranking-model retraining, embedding pipelines, or evaluation harnesses.
• Experience in assessing non-deterministic systems through the use of golden datasets, LLM-as-judge, and regression tests that govern launches.
• Solid understanding of core machine learning concepts, including classification, ranking, and model evaluation.
• Experience with production LLMs, covering prompt engineering, tool calling, structured outputs, agent workflows, and voice workflows.
• Proficient in SQL-driven product analysis.
• Ability to configure an environment and train or run a model independently using notebooks.
• Experience with marketplaces or recommendation systems, production voice agents, embedding retrieval at scale, Claude Code, or full-stack development will be considered advantageous.
• Relevant skills in Python, FastAPI, Celery, Rails, React, ElasticSearch, embeddings, Snowflake, dbt, Hex, Anthropic Claude, and ElevenLabs are pertinent to this role.
• Candidates must reside in an eligible U.S. state or the District of Columbia.
• Competitive salary based on market standards, aligned with skills and experience.
• Medical, dental, and vision insurance with shared premiums.
• Company-sponsored 401(k) plan.
• Potential for commission and/or equity based on the position.
• Unlimited vacation policy.
• Generous family leave policy.
• Team-building events and trivia sessions.
• Commitment to equal opportunity and reasonable accommodations for qualified individuals with disabilities.
9th Way Insignia
Cleveland Clinic
Cencora
Get handpicked remote jobs straight to your inbox weekly.