Quality Engineer – Automation, AI

This is a fully remote position, open to applicants in Pakistan.

📋 Description

• Develop risk-oriented testing strategies for new features and releases, quickly transforming these strategies into automated coverage through AI-assisted development workflows.

• Utilize Claude Code within VS Code or similar AI coding agents as your main development environment for generating, scaling, and sustaining automated test coverage.

• Construct and uphold automated test suites using Playwright, seamlessly integrated within GitHub CI/CD pipelines, ensuring the inclusion of quality gates throughout the software development lifecycle.

• Design and execute agentic testing workflows that create, modify, and maintain automated tests leveraging AI models and APIs.

• Create reusable frameworks, utilities, shared libraries, and AI-driven tools that enhance test authoring speed across engineering teams.

• Collaborate closely with engineers, product managers, and designers to enhance quality at the outset, influencing requirements, design choices, observability, and deployment strategies.

• Persistently enhance the health of test suites by minimizing flakiness, boosting execution speed, and guaranteeing dependable quality signals for each release.

• Promote quality upstream by early identification of risks and the implementation of preventative quality measures.

• Take ownership of and refine quality metrics such as automated coverage growth, escaped defects, test execution performance, flakiness rates, and release confidence.

• Empower developers to write, execute, and manage automated tests as part of their daily routines.

⛳️ Requirements

• Solid software engineering fundamentals, with the capability to review, validate, and debug code in any modern programming language.

• Extensive experience with contemporary test automation frameworks, ideally Playwright.

• Proven ability to utilize AI coding agents as a primary development partner for generating, reviewing, debugging, refactoring, and maintaining code.

• Comfortable assigning significant portions of implementation tasks to AI agents while upholding high engineering and quality standards.

• Experience in building and sustaining scalable automation frameworks.

• Familiarity with integrating automated test suites into CI/CD pipelines utilizing GitHub Actions or similar platforms.

• Experience with agentic testing frameworks, AI-enhanced testing tools, or LLM API integrations within engineering workflows.

• Demonstrated success in increasing automation coverage, decreasing manual effort, and enhancing software quality outcomes.

• Strong knowledge of quality engineering principles, test strategies, risk assessment, and defect prevention techniques.

• Comfortable working as an embedded engineer within cross-functional product teams.

• Excellent communication skills with the ability to provide clear, actionable updates and collaborate effectively across teams.

• A sense of curiosity, adaptability, and a growth mindset towards emerging AI technologies and engineering practices.

• Nice to Have

• Experience testing AI-driven products, agents, or LLM-based applications.

• Background in designing evaluation frameworks for AI-generated outputs.

• Familiarity with prompt engineering, AI quality assessment, and AI observability.

• Experience with performance, load, or resilience testing.

• Familiarity with test management platforms integrated with Jira.

• Experience in building internal developer platforms, testing tools, or solutions to enhance engineering productivity.

🏝️ Benefits

• Opportunity to work with cutting-edge AI technologies.

• Collaborative and innovative work environment.

• Professional development and growth opportunities.

• Competitive salary and benefits package.