Principal Engineer, AI Lead – Quality Engineering

This is a fully remote position, open to applicants in United States.

📋 Description

• Act as a lead in Quality Engineering within CarMax's Product and Technology division.

• Propel CarMax's quality engineering strategy to guarantee that thoroughly tested, high-performance software is deployed.

• Guide and mentor test automation initiatives across the organization.

• Develop and execute testing strategies for various teams.

• Promote modern testing methodologies to shift testing earlier in the development process and enhance workflows.

• Generate and communicate key quality metrics to stakeholders.

• Design and construct testing infrastructure and integrations for regression and integration testing.

• Oversee bug triage processes, prioritize issues, and manage the resolution of critical defects.

• Assess and implement new tools and techniques to boost automation efficiency.

• Contribute to the AI engineering vision and roadmap for Quality Engineering.

• Architect and deploy AI-driven testing systems, which include autonomous test generation, self-healing automation frameworks, intelligent defect triage, and predictive quality/risk analytics.

• Direct the integration of LLM- and agent-based systems into CI/CD and Quality Engineering workflows.

• Establish enterprise governance, evaluation, and risk frameworks for AI adoption in testing.

• Represent Quality Engineering in enterprise AI governance discussions.

• Advocate and enhance the broader engineering organization's understanding of AI-augmented quality practices.

⛳️ Requirements

• A Bachelor's degree in Computer Science or a related field with over 7 years of experience, or a Master's degree with more than 5 years of experience.

• Over 8 years of experience in Quality Engineering with a strong background in automation frameworks.

• Advanced knowledge of IT systems, including system design, object-oriented principles, databases, and programming basics (HTML, JavaScript/TypeScript, Web Services).

• Expertise in modern test automation tools.

• Excellent communication and organizational skills to influence strategic initiatives across diverse teams.

• Capability to manage multiple work streams and achieve results in a dynamic environment.

• Proven experience in architecting and deploying AI/ML or generative AI systems within a production software quality or testing context.

• Strong familiarity with LLM architectures, agentic frameworks, and APIs, including advanced prompt engineering and evaluation methodologies.

• Candidates must be authorized to work in the United States on a full-time basis.

• Sponsorship is not applicable for this specific position.

• Preferred: Experience with NodeJS and WebDriverIO/Playwright.

• Preferred: Knowledge of NodeJS / C# / TypeScript.

• Preferred: Experience in API/integration test automation.

• Preferred: Proficiency in API and integration test automation frameworks.

• Preferred: Knowledge of C# .NET Core, and Azure or similar cloud technologies.

• Preferred: Experience in REST API testing.

• Preferred: Background in API design and development.

• Preferred: Interest and knowledge in App tier/Service layer methodologies.

• Preferred: Experience in designing and scaling AI agents/copilots integrated directly into CI/CD and enterprise QE pipelines.

• Preferred: Practical experience with RAG pipelines, vector databases, and Python-based ML tools in a testing or quality analytics context.

• Preferred: Proven success using AI/ML to achieve measurable results in defect prediction, test prioritization, or coverage optimization at an organizational level.

🏝️ Benefits

• Eligibility for bonuses.

• Opportunity for equity participation.

• Paid sick leave.

• Paid vacation time.

• Paid holidays.

• Floating holiday.

• Holiday premium pay when working on a scheduled holiday due to business needs.

• Paid bereavement leave.

• Paid jury duty leave.

• Unlimited paid time off as needed for full-time salaried associates, subject to manager approval.

• Reasonable accommodation for the CarMax Job Application.