Principal Quality Engineer, AI-Assisted and Agentic Testing

Posted 1 day ago

This is a fully remote position, open to applicants in Mexico.

📋 Description

• Revolutionize quality engineering methodologies by incorporating AI-assisted testing, agentic automation, and contemporary quality engineering frameworks within intricate enterprise settings.

• Collaborate directly with a client's engineering team.

• Evaluate current testing methodologies.

• Create scalable test automation solutions.

• Utilize Claude Code and AI coding agents to expedite test development, regression testing, and quality assurance.

• Participate in production testing efforts.

• Design reusable AI-assisted testing workflows.

• Guide QA engineers and developers through practical collaboration and hands-on engagement.

• Navigate enterprise applications that include COBOL systems, Java/Spring middleware, and TypeScript/React frontends.

• Maintain quality across integrated, mission-critical systems.

• Develop production-ready test automation frameworks.

• Convert manual testing processes into scalable, AI-assisted automation workflows.

• Create reusable AI testing toolkits, custom agent skills, prompts, and validation guardrails.

• Establish testing strategies, tooling configurations, and enhancements in quality engineering.

• Enhance test coverage, regression cycle times, and the capabilities of engineering teams.


⛳️ Requirements

• Over 10 years of professional experience in Quality Assurance, Test Automation, Software Development Engineering in Test (SDET), or similar software engineering positions.

• Extensive hands-on experience in designing and building test automation frameworks from the ground up, utilizing tools like Playwright, Cypress, or equivalent technologies.

• Advanced skills in API testing, integration testing, end-to-end testing, and automated regression testing.

• Practical experience with Claude Code, Claude CLI, GitHub Copilot, or AI coding agents for generating, reviewing, refactoring, and maintaining automated tests.

• Proficient in configuring agentic testing workflows, including prompts, custom skills, repository memory files, guidelines, and reusable AI-assisted testing patterns.

• Demonstrated ability to transform manual regression suites into automated tests, especially within existing enterprise applications.

• Strong background in integrating automated tests into CI/CD pipelines using tools like GitHub Actions, Jenkins, or similar platforms.

• Comprehensive understanding of test strategy, risk-based testing, test data management, coverage analysis, and flaky-test diagnosis.

• Capability to critically assess AI-generated test cases and scripts, identifying gaps in coverage, incorrect assumptions, unreliable assertions, and potential security vulnerabilities.

• Experience in establishing guardrails and validation processes for AI-generated tests, including secure management of credentials, dependencies, and sensitive information.

• Proficient in defining, tracking, and enhancing quality engineering metrics.

• Familiarity with testing AI-powered applications, particularly in evaluating LLM-generated outputs.

• Understanding of Agentic AI Evaluations (Evals), including evaluation datasets, scoring criteria, reliability metrics, and human review procedures.

• Proven experience in mentoring and elevating the skills of QA engineers and developers.

• Working knowledge of Git, Jira, and test management platforms such as Xray, TestRail, or Zephyr.

• Experience with COBOL, mainframe, legacy enterprise applications, or financial services systems is preferred.

• Excellent communication and consulting abilities.

• Additional qualifications include experience with COBOL-based systems of record, custom Claude Code agents, LLM evaluation frameworks, legacy business rules, AI-assisted test data generation, regulated enterprise environments, cross-team AI-assisted quality engineering, QA playbooks, and metrics for productivity measurement.


🏝️ Benefits

• Fully remote work

• Collaborative, innovative environment

• Hands-on pairing and collaborative development

• Autonomy to define testing strategies, tooling configurations, and quality engineering improvements

• Opportunity to mentor and upskill QA engineers and developers

• Work with AI-assisted testing tools and agentic AI technologies

• Chance to develop production-ready test automation frameworks and reusable AI testing toolkits

People also viewed

Republic Services8 hours ago

Senior Quality Assurance Engineer

US flagUnited States OnlyFull-timeQA Engineer (Quality Assurance)
ApplyView job
Intuitive9 hours ago

Staff Supplier Quality Engineer, ISO 13485 Lead Auditor

GE flagGeorgia OnlyFull-timeQA Engineer (Quality Assurance)$155.5k – $263.1k/year
ApplyView job
GE Aerospace9 hours ago

Lead Sourcing Specialist 2 – Supplier Quality Engineering

US flagMassachusetts OnlyFull-timeQA Engineer (Quality Assurance)$86k – $114k/year
ApplyView job
Syner-G BioPharma Group9 hours ago

Quality Engineer

US flagUnited States OnlyFull-timeQA Engineer (Quality Assurance)$120k – $150k/year
ApplyView job
Unqork9 hours ago

Senior QA Engineer – Runtime

US flagUnited States OnlyFull-timeQA Engineer (Quality Assurance)$100k – $137k/year
ApplyView job
HEAVY CONSTRUCTION SYSTEMS SPECIALISTS INC9 hours ago

QA Analyst I

US flagUnited States OnlyFull-timeQA Engineer (Quality Assurance)
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers