
AI Engineer
Posted 5 hours ago

Posted 5 hours ago
This is a fully remote position, open to applicants in United States.
• Develop and implement production-ready AI functionalities, including workflows powered by LLMs, retrieval-augmented generation, agentic systems, tool-using systems, classification and extraction pipelines, along with traditional machine learning models.
• Take responsibility for ingestion, chunking, embedding, indexing, and retrieval quality.
• Create offline evaluation sets and online feedback mechanisms; establish quality benchmarks and monitor for regressions.
• Incorporate AI features into applications and services via APIs, while considering latency, cost, failure scenarios, and graceful degradation.
• Implement monitoring and instrumentation for deployed systems to track quality drift, hallucination rates, token expenditure, and potential abuse.
• Adhere to responsible AI principles, ensuring data privacy and residency, handling of personally identifiable information (PII), prompt injection safeguards, data exfiltration prevention, access control measures, and documentation of model limitations.
• Rapidly prototype solutions, then assess what to strengthen or eliminate.
• Contribute to the establishment of internal standards, reusable components, reference architectures, and scalable patterns.
• Communicate technical trade-offs effectively to non-technical stakeholders, including clients and executives.
• Over 3 years of professional experience in software engineering, with at least 1 year focused on building LLMs or machine learning systems in a production environment.
• Proficient in Python.
• Working knowledge of at least one of the following languages: TypeScript/JavaScript, C#, Java, or Go for service and application integration.
• Proven experience in delivering an AI feature from concept to deployment, including evaluation, troubleshooting, and enhancements.
• Solid understanding of prompt design, structured outputs, function/tool invocation, context management, and familiarity with at least one orchestration framework or a well-reasoned justification for not using one.
• Experience with retrieval systems and vector search, including the ability to diagnose ineffective retrieval outcomes.
• Familiarity with cloud deployment on platforms such as Azure, AWS, or GCP.
• Knowledge of containers, CI/CD processes, and infrastructure-as-code principles.
• Proficient in SQL and experienced in handling complex, real-world data.
• Excellent written and verbal communication skills, with the ability to operate effectively under ambiguous requirements.
• Competitive salary and performance-based bonuses.
• Opportunities for professional development and career advancement.
• Comprehensive health, dental, and vision insurance.
• Flexible work hours and remote work options.
• A collaborative and inclusive work environment.
MarcoPolo Learning
Mercor
24-MAG
Get handpicked remote jobs straight to your inbox weekly.