AI Engineer II, AI Platform

This is a fully remote position, open to applicants in United States.

📋 Description

• Implement components of the AI platform, such as model serving layers, retrieval infrastructure, prompt management, and output evaluation services, under the supervision of Senior and Staff engineers.

• Develop and maintain APIs that enable product teams to integrate AI functionalities into their applications.

• Incorporate observability and monitoring into platform services to assess output quality, latency, cost, and overall system health.

• Engage in design discussions and provide insights on trade-offs regarding simplicity, reliability, and scalability.

• Collaborate with product engineering teams to understand their AI capability needs and convert those requirements into platform features.

• Take part in technical design sessions and code reviews with product teams utilizing the AI platform.

• Assist in identifying scenarios where multiple product teams are addressing the same AI integration issue and streamline that work.

• Contribute to the creation of documentation, reference implementations, and runbooks to facilitate the adoption of AI platform services by product teams.

• Help define and uphold integration standards, including API contracts, error handling patterns, and cost attribution.

• Mentor junior engineers (Engineer I) and support their understanding of AI systems and platform design.

• Implement evaluation and monitoring pipelines that provide teams with insights into AI output quality and model behavior.

• Contribute to establishing content safety standards and compliance measures suitable for a regulated financial services environment.

• Assist in designing systems that effectively manage PII, maintain audit trails, and comply with data residency requirements in AI pipelines.

⛳️ Requirements

• 3–5 years of professional software engineering experience.

• Strong expertise in backend engineering utilizing Python, C#/.NET, Java, or Node.js.

• Solid grasp of algorithms, data structures, and principles of system design.

• Hands-on experience in integrating large language models or ML models into production applications.

• Familiarity with retrieval-augmented generation (RAG) concepts, vector databases, and embedding pipelines.

• Experience in building or contributing to shared services or platform components.

• Knowledge of cloud-managed AI services (AWS Bedrock, Azure OpenAI, or equivalent).

• Experience with APIs, asynchronous processing, and event-driven architectures.

• Bachelor's degree in Computer Science, Software Engineering, or equivalent professional experience.

🏝️ Benefits

• Insurance coverage (medical, dental, vision, life, and disability).

• Flexible paid time off.

• Paid holidays.

• 401(k) plan with company match.

• Remote work.