Manager, ML Solutions Architecture

This is a fully remote position, open to applicants in United States.

📋 Description

• Lead a regional team of 4 Solutions Architects in the US, with plans for ongoing growth.

• Conduct individual meetings, set goals, perform performance evaluations, handle promotion cases, and create individual growth plans.

• Assign accounts and projects based on each Solutions Architect's expertise and interests.

• Identify potential blockers early and collaborate with development, product, and business teams to address them.

• Hold team members accountable for their delivery outcomes, reflecting performance in ratings and compensation decisions.

• Guide new hires through their initial independently managed engagement.

• Mentor Solutions Architects and assess their readiness for broader responsibilities.

• Take ownership of team delivery outcomes, including time from PoC to endpoint, success criteria achievement rate, and quality of post-production technical relationships.

• Review benchmarking methodologies, serving configurations, results, and closure documents prior to customer delivery.

• Ensure appropriate staffing and escalation coverage across accounts and time zones.

• Recognize infeasibility early and provide supporting evidence.

• Maintain and enhance documentation, runbooks, guides, onboarding materials, definitions of done, and closure templates.

• Ensure that documentation is utilized and maintain the ticket tracker as the official record.

• Define and report on delivery speed and reliability metrics.

• Convert recurring customer challenges into prioritized platform initiatives with development and research teams.

• Oversee the boundary between scoping and execution with pre-sales.

• Coordinate production handoffs and manage post-sales technical requests in collaboration with account management.

• Report on account health, technical feasibility, and capacity requirements to business and leadership.

• Report to the Head of Solutions Architecture and collaborate with a peer manager in another region.

• Provide PoCs and post-sales technical support for the Nebius Token Factory, a serverless platform designed for deploying and customizing open-source LLMs in production.

⛳️ Requirements

• Over 3 years of experience managing technical teams, including performance management and handling difficult conversations.

• Experience in managing a customer-facing team.

• Strong knowledge of machine learning: LLM architectures, SFT/LoRA/RL-based fine-tuning, evaluation design, inference internals, quantization, KV-cache management, batching, routing, speculative decoding, vLLM, SGLang, and TensorRT-LLM.

• Technical judgment to assess benchmarks and identify methodological flaws.

• Proficient in Python to read and review the team's code.

• Exceptional communication skills for conveying technical concepts to diverse audiences, including enterprise customers under pressure.

• Ability to handle operational tasks: documentation, process design, reporting, and follow-through.

• Comfortable working with ambiguity across distributed teams and time zones.

• Applicants must have authorization to work in the country where they apply and provide proof of employment eligibility.

• Preferred technical stack includes Python; vLLM, TensorRT-LLM, SGLang, Transformers, OpenAI/Anthropic SDKs; Kubernetes, Docker, Git; AWS, GCP, and Azure ML platforms.

🏝️ Benefits

• Competitive compensation.

• Opportunities for career growth and learning.

• Flexibility and ownership in your work.

• A collaborative and innovative culture.

• The chance to engage in impactful AI projects.

• An international environment with talented teams.