
Principal Quality Engineer, AI-Assisted and Agentic Testing
Posted 1 day ago

Posted 1 day ago
This is a fully remote position, open to applicants in Mexico.
• Revolutionize quality engineering methodologies by incorporating AI-assisted testing, agentic automation, and contemporary quality engineering frameworks within intricate enterprise settings.
• Collaborate directly with a client's engineering team.
• Evaluate current testing methodologies.
• Create scalable test automation solutions.
• Utilize Claude Code and AI coding agents to expedite test development, regression testing, and quality assurance.
• Participate in production testing efforts.
• Design reusable AI-assisted testing workflows.
• Guide QA engineers and developers through practical collaboration and hands-on engagement.
• Navigate enterprise applications that include COBOL systems, Java/Spring middleware, and TypeScript/React frontends.
• Maintain quality across integrated, mission-critical systems.
• Develop production-ready test automation frameworks.
• Convert manual testing processes into scalable, AI-assisted automation workflows.
• Create reusable AI testing toolkits, custom agent skills, prompts, and validation guardrails.
• Establish testing strategies, tooling configurations, and enhancements in quality engineering.
• Enhance test coverage, regression cycle times, and the capabilities of engineering teams.
• Over 10 years of professional experience in Quality Assurance, Test Automation, Software Development Engineering in Test (SDET), or similar software engineering positions.
• Extensive hands-on experience in designing and building test automation frameworks from the ground up, utilizing tools like Playwright, Cypress, or equivalent technologies.
• Advanced skills in API testing, integration testing, end-to-end testing, and automated regression testing.
• Practical experience with Claude Code, Claude CLI, GitHub Copilot, or AI coding agents for generating, reviewing, refactoring, and maintaining automated tests.
• Proficient in configuring agentic testing workflows, including prompts, custom skills, repository memory files, guidelines, and reusable AI-assisted testing patterns.
• Demonstrated ability to transform manual regression suites into automated tests, especially within existing enterprise applications.
• Strong background in integrating automated tests into CI/CD pipelines using tools like GitHub Actions, Jenkins, or similar platforms.
• Comprehensive understanding of test strategy, risk-based testing, test data management, coverage analysis, and flaky-test diagnosis.
• Capability to critically assess AI-generated test cases and scripts, identifying gaps in coverage, incorrect assumptions, unreliable assertions, and potential security vulnerabilities.
• Experience in establishing guardrails and validation processes for AI-generated tests, including secure management of credentials, dependencies, and sensitive information.
• Proficient in defining, tracking, and enhancing quality engineering metrics.
• Familiarity with testing AI-powered applications, particularly in evaluating LLM-generated outputs.
• Understanding of Agentic AI Evaluations (Evals), including evaluation datasets, scoring criteria, reliability metrics, and human review procedures.
• Proven experience in mentoring and elevating the skills of QA engineers and developers.
• Working knowledge of Git, Jira, and test management platforms such as Xray, TestRail, or Zephyr.
• Experience with COBOL, mainframe, legacy enterprise applications, or financial services systems is preferred.
• Excellent communication and consulting abilities.
• Additional qualifications include experience with COBOL-based systems of record, custom Claude Code agents, LLM evaluation frameworks, legacy business rules, AI-assisted test data generation, regulated enterprise environments, cross-team AI-assisted quality engineering, QA playbooks, and metrics for productivity measurement.
• Fully remote work
• Collaborative, innovative environment
• Hands-on pairing and collaborative development
• Autonomy to define testing strategies, tooling configurations, and quality engineering improvements
• Opportunity to mentor and upskill QA engineers and developers
• Work with AI-assisted testing tools and agentic AI technologies
• Chance to develop production-ready test automation frameworks and reusable AI testing toolkits
Republic Services
Intuitive
GE Aerospace
Syner-G BioPharma Group
Get handpicked remote jobs straight to your inbox weekly.