
Staff AI Engineer
Posted 6 hours ago

Posted 6 hours ago
This is a fully remote position, open to applicants in United States.
• Design a cohesive, low-latency personalization engine that models user intent, preferences, and constraints across various product verticals.
• Establish representation, governance, and real-time integration of long-term user states into agentic planning processes.
• Collaborate with engineers, research scientists, technical program managers, and product managers to deliver AI-driven products.
• Create, develop, test, deploy, and maintain AI software components, including foundation model training, LLM inference, agents, multi-agent workflows, similarity search, guardrails, evaluation, experimentation, governance, and observability.
• Utilize AI technologies such as AWS Ultraclusters, Hugging Face, VectorDBs, and PyTorch.
• Innovate and implement foundation model optimization strategies to enhance scalability, cost-efficiency, latency, and throughput.
• Contribute to the technical vision and long-term strategy for foundational AI systems.
• Define the technical direction for enterprise-wide AI architecture, consolidating tooling, observability, and deployment standards.
• Oversee model routing, caching, and orchestration systems for both hybrid and multi-model workloads.
• Advocate for responsible AI principles, transparency, reproducibility, and fairness-by-design.
• Promote internal education, mentorship, and best practices through architecture councils and AI guilds.
• Bachelor's Degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with a minimum of 8 years of experience in developing AI and ML algorithms or technologies, or a Master's degree in these fields with at least 6 years of experience.
• At least 8 years of programming experience in Python, Go, Scala, CUDA, or Java.
• Experience in designing AI systems that balance cost, latency, throughput, and accuracy.
• Proven experience deploying scalable and responsible AI solutions on cloud platforms.
• Background in architecting, designing, developing, integrating, delivering, and supporting complex AI systems.
• Experience in developing AI and ML algorithms or technologies using Python, C++, C#, Java, CUDA, or Golang.
• Experience in optimizing training and inference software for hardware utilization, latency, throughput, and cost.
• Experience in building agentic AI systems and workflows.
• Demonstrated history of defining and operationalizing enterprise AI architecture standards.
• Experience in leading federated or multi-cloud AI strategies.
• Proven success in influencing research-to-production promotion processes.
• Experience in defining north-star metrics for AI systems.
• Experience in right-sizing models, instance counts, and hardware specifications.
• Ability to lead and mentor multiple engineering teams and influence cross-functional stakeholders up to the VP level.
• Excellent communication and presentation abilities.
• Capital One is open to sponsoring a new qualified applicant for employment authorization.
• Performance-based incentive compensation, which may include cash bonuses and/or long-term incentives (LTI).
• Comprehensive, competitive, and inclusive health, financial, and other benefits that support overall well-being.
• Employment authorization sponsorship may be available for new qualified applicants.
• Reasonable accommodations for applicants who require them.
Extend
OhioHealth
Software Mind
Terac
Get handpicked remote jobs straight to your inbox weekly.