Engineering Manager – AI Product

This is a fully remote position, open to applicants in Turkey.

📋 Description

• Lead, mentor, and develop a small team of engineers dedicated to AI platform and product engineering.

• Guide the architectural vision for the AI product, focusing on inference performance, reliability, cost efficiency, and enhancing developer experience.

• Engage hands-on in the design, implementation, and optimization of model serving, inference pipelines, retrieval, orchestration, and evaluation systems.

• Take ownership of the AI/ML platform from start to finish, managing GPU capacity and scheduling, model deployment and versioning, data and embedding pipelines, monitoring, and quality assessment.

• Collaborate with Product, Infrastructure, Security, and Backend teams to establish priorities and ensure seamless integrations.

• Conduct regular one-on-ones, performance evaluations, and provide technical coaching.

• Promote a culture of ownership, engineering excellence, and continuous improvement.

• Convert strategic goals into actionable plans and guarantee timely execution.

• Shape the evolution of the AI platform through practical technical decisions.

• Advocate for best practices in software development, automation, evaluation, and operational excellence.

⛳️ Requirements

• Over 7 years of experience in software engineering.

• More than 2 years in a technical leadership or engineering management capacity.

• Demonstrated experience in building and managing AI/ML platforms or inference infrastructure in a production environment.

• Proficient in model serving, GPU workloads, latency optimization, and cost reduction strategies.

• Experience in constructing distributed backend systems.

• Strong proficiency in Python.

• Familiarity with systems programming languages like Go or Rust is advantageous.

• Knowledge of model APIs, open-weight models, vLLM, TGI, Triton, retrieval/vector databases, and prompt or context engineering.

• Understanding of evaluation frameworks, benchmarking, regression testing, and observability for non-deterministic systems.

• Strong expertise in cloud platforms, particularly AWS, encompassing EC2, ECS, Lambda, IAM, and CloudWatch.

• Familiarity with Kubernetes, containerization, and Infrastructure-as-Code tools such as Terraform, Pulumi, or AWS CDK.

• Comprehension of CI/CD automation, including GitHub Actions or CircleCI.

• Solid knowledge of Linux systems, networking fundamentals, and best practices for monitoring and alerting.

• Exceptional communication and leadership capabilities.

• Strong technical judgment with the ability to balance coding responsibilities with interpersonal and strategic tasks.

🏝️ Benefits

• Fully remote work environment.

• Flexibility in a remote-first setting.

• Opportunity to engage with cutting-edge LLM, inference infrastructure, GPU computing, and distributed systems technologies.

• Leadership, mentorship, and strategic technical growth opportunities.

• Cross-functional collaboration with Product, Infrastructure, Security, and Backend teams.