Senior Staff AI Engineer

This is a fully remote position, open to applicants in California, +3 more states.

📋 Description

• Collaborate with engineers, research scientists, technical program managers, and product managers to create AI-driven products.

• Design, develop, test, deploy, and maintain AI software components, which encompass foundation model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.

• Utilize open-source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, VectorDBs, and PyTorch.

• Innovate and implement cutting-edge foundation model optimization techniques to enhance scalability, cost efficiency, latency, and throughput.

• Contribute to the technical vision and strategic roadmap for foundational AI systems.

• Define and guide the technical AI architecture, integrating applied research into dependable and scalable production environments.

• Establish performance, safety, and transparency standards for model development and deployment across the company.

• Lead multi-year platform initiatives that unify data, compute, and model lifecycle management under an enterprise AI architecture.

• Mentor senior technical leaders across research, data, and engineering disciplines.

⛳️ Requirements

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field along with a minimum of 10 years of experience in developing AI and ML algorithms or technologies; or a Master's degree in a related field with at least 8 years of such experience.

• A minimum of 10 years of programming experience in Python, Go, Scala, CUDA, or Java.

• Preferred: Experience in architecting AI platforms considering cost, latency, throughput, and accuracy trade-offs.

• Preferred: Over 9 years of experience deploying scalable and responsible AI solutions on cloud platforms.

• Preferred: Experience in architecting, designing, developing, integrating, delivering, and supporting complex AI systems.

• Preferred: Proven ability to lead and mentor multiple engineering teams and influence senior cross-functional stakeholders.

• Preferred: Familiarity with AI/ML technologies including LLM inference, similarity search, VectorDBs, guardrails, and memory.

• Preferred: Experience in optimizing training and inference software for hardware utilization, latency, throughput, and cost.

• Preferred: Experience in building agent-based AI systems and workflows.

• Preferred: Knowledge of current AI research and the application of novel techniques in production environments.

• Preferred: Excellent communication and presentation skills for effectively conveying complex AI concepts.

• Preferred: Industry leadership in applied AI or machine learning infrastructure demonstrated through patents, publications, or open-source contributions.

• Preferred: Experience in designing long-term AI infrastructure strategies that balance cost, scale, ethics, and regulatory compliance.

• Preferred: Experience in driving organization-wide AI safety, alignment, and governance standards.

• Preferred: Ability to shape R&D investment strategies focused on breakthrough AI capabilities.

• Preferred: Experience in right-sizing models, instance counts, and hardware types.

• Capital One is open to sponsoring a new qualified applicant for employment authorization.

🏝️ Benefits

• Performance-based incentive compensation, which may include cash bonuses and/or long-term incentives (LTI).

• Comprehensive health, financial, and other benefits that support total well-being.

• Reasonable accommodations for applicants with disabilities.