
Staff AI Engineer
Posted 12 hours ago

Posted 12 hours ago
This is a fully remote position, open to applicants in United States.
• Collaborate with engineers, research scientists, technical program managers, and product managers to create AI-driven products.
• Design, develop, test, deploy, and maintain AI software components, encompassing foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Utilize Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, and PyTorch.
• Develop and implement foundation model optimization strategies to enhance scalability, cost-efficiency, latency, and throughput of production AI systems.
• Contribute to the technical vision and long-term strategy of foundational AI systems.
• Establish technical direction for enterprise-wide AI architecture, tools, observability, and deployment standards.
• Oversee the design and integration of model routing, caching, and orchestration systems for hybrid and multi-model workloads.
• Promote responsible AI principles, including transparency, reproducibility, and fairness-by-design.
• Foster internal education, mentorship, and the sharing of best practices through architecture councils and AI guilds.
• A Bachelor's Degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related disciplines, along with a minimum of 8 years of experience in developing AI and ML algorithms or technologies; or a Master's degree in the same fields with at least 6 years of experience.
• A minimum of 8 years of programming experience in Python, Go, Scala, CUDA, or Java.
• Experience in designing AI systems with considerations for cost, latency, throughput, and accuracy trade-offs.
• 8 years of experience in deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud).
• Expertise in architecting, designing, developing, integrating, delivering, and supporting complex AI systems.
• Proven ability to lead and mentor multiple engineering teams and influence cross-functional stakeholders up to the VP level.
• Experience in developing AI and ML algorithms or technologies using Python, C++, C#, Java, CUDA, or Golang.
• Experience in developing and implementing cutting-edge techniques for optimizing training and inference software to enhance hardware utilization, latency, throughput, and cost.
• Experience in building agentic AI systems and workflows.
• Experience in defining and operationalizing enterprise AI architecture standards, including data pipeline governance, observability, and evaluation frameworks.
• Experience in leading federated or multi-cloud AI strategies to maximize resilience, compliance, and compute efficiency.
• Proven track record of influencing research-to-production promotion processes.
• Experience in defining north-star metrics for AI systems.
• Experience in right-sizing models, instance counts, and hardware types.
• Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
• Performance-based incentive compensation, which may include cash bonuses and/or long-term incentives (LTI).
• Comprehensive, competitive, and inclusive health, financial, and other benefits that support your overall well-being.
Extend
OhioHealth
Capital One
Software Mind
Get handpicked remote jobs straight to your inbox weekly.