Engineering Manager – AI Product

This is a fully remote position, open to applicants in Armenia.

📋 Description

• Lead, mentor, and develop a team of 3 engineers dedicated to AI platform and product engineering.

• Set the architectural vision for the AI product, focusing on inference performance, reliability, cost-effectiveness, and developer experience.

• Actively participate in the design, implementation, and optimization of model serving, inference pipelines, retrieval, orchestration, and evaluation systems.

• Oversee the AI/ML platform from start to finish, managing GPU capacity and scheduling, model deployment and versioning, data and embedding pipelines, monitoring, and quality assessment.

• Collaborate with Product, Infrastructure, Security, and Backend teams to establish priorities and facilitate seamless integrations.

• Conduct regular one-on-one meetings, performance evaluations, and provide technical coaching.

• Promote ownership, engineering excellence, and a culture of continuous improvement.

• Convert strategic goals into actionable plans and ensure timely execution.

• Drive the evolution of the AI platform through pragmatic technical choices.

• Advocate for best practices in software development, automation, evaluation, and operational excellence.

⛳️ Requirements

• Over 7 years of experience in software engineering.

• More than 2 years in a technical leadership or engineering management position.

• Demonstrated experience in building and maintaining AI/ML platforms or inference infrastructure in a production environment.

• Experience with model serving, GPU workloads, latency optimization, and cost management.

• Extensive experience in constructing distributed backend systems.

• Proficient in Python.

• Knowledge of a systems programming language such as Go or Rust is advantageous.

• Practical experience with model APIs, open-weight models, vLLM, TGI, Triton, or similar serving frameworks, retrieval/vector databases, and prompt or context engineering.

• Strong understanding of evaluation frameworks, benchmarking, regression testing, and observability for non-deterministic AI systems.

• Deep expertise in cloud platforms, preferably AWS, including EC2, ECS, Lambda, IAM, and CloudWatch.

• Familiarity with Kubernetes, containerization, and Infrastructure-as-Code tools like Terraform, Pulumi, or AWS CDK.

• Comprehension of CI/CD automation using GitHub Actions, CircleCI, or similar technologies.

• Comprehensive knowledge of Linux systems, networking basics, and best practices for monitoring and alerting.

• Exceptional communication and leadership abilities.

• Strong technical judgment with the capacity to balance coding responsibilities with interpersonal and strategic duties.

🏝️ Benefits

• Fully remote position.

• Remote-first flexibility.

• Chance to engage with cutting-edge LLM, inference infrastructure, GPU computing, and distributed systems technology.

• Opportunities for leadership, mentoring, and strategic technical growth.

• Cross-functional collaboration with Product, Infrastructure, Security, and Backend teams.