Senior Engineering Manager, AI

This is a fully remote position, open to applicants in United States.

📋 Description

• Lead the AI Platform team in the development and operation of AlphaSense’s primary AI Gateway.

• Oversee, mentor, and expand a team of up to 10 senior and staff software engineers, primarily located across North America.

• Cultivate a high-performance culture that emphasizes technical excellence, reliable delivery, and opportunities for career advancement.

• Take ownership of the strategy and architecture of the enterprise AI Gateway, which processes up to 1 trillion LLM tokens weekly.

• Ensure the system maintains high availability, sub-millisecond routing, efficient caching, effective queueing, and robust fallback mechanisms.

• Guide the integration, assessment, and management of more than 6 major LLM vendors and over 50 distinct models.

• Optimize multi-vendor orchestration for factors such as latency, cost, and reliability.

• Collaborate with product management, AI research teams, and executive engineering leads on the gateway roadmap.

• Define and advocate for software engineering best practices and architectural standards.

• Implement token-based cost-tracking telemetry across the AI Platform organization.

⛳️ Requirements

• Proven experience in managing and developing high-performing teams of senior and staff engineers.

• Background in cultivating technical leaders and aligning engineering goals with business strategies.

• Experience in designing, building, and operating high-throughput, low-latency distributed systems.

• Familiarity with complex routing, caching, queueing, or rate-limiting mechanisms.

• Capability to engage in high-level architectural discussions and offer technical guidance.

• Outstanding communication and collaboration skills with engineering, product, and executive stakeholders.

• Active use of AI tools within developer workflows and a mindset focused on AI-first approaches.

• Experience in applied AI or familiarity with LangChain, LangGraph, LiteLLM, or OpenRouter is a plus.

• Experience with Temporal, Envoy, or other similar enterprise-grade gateway technologies is advantageous.

• Proficiency in Python, Java, and highly distributed caching/queueing systems is a bonus.

🏝️ Benefits

• Equity may be available.

• Comprehensive benefits program.

• AlphaSense does not require candidates to pay for job applications, equipment, or training.