Quality Engineer – Automation, AI

This is a fully remote position, open to applicants in Portugal.

📋 Description

• Develop risk-oriented testing strategies for new features and releases, swiftly translating those strategies into automated coverage through AI-enhanced development workflows.

• Utilize Claude Code within VS Code or similar AI coding tools as the main development environment to create, scale, and sustain automated test coverage.

• Construct and uphold automated test suites using Playwright, incorporated within GitHub CI/CD pipelines, ensuring that quality gates are integrated throughout the software development lifecycle.

• Design and execute agentic testing workflows that create, adjust, and maintain automated tests utilizing AI models and APIs.

• Create reusable frameworks, utilities, shared libraries, and AI-driven tools that enhance test authoring speed across engineering teams.

• Collaborate closely with engineers, product managers, and designers to shift quality considerations earlier in the process, influencing requirements, design choices, observability, and deployment strategies.

• Continuously enhance test suite health by minimizing flakiness, boosting execution speed, and guaranteeing reliable quality signals for each release.

• Promote quality upstream by identifying risks early and implementing proactive quality practices.

• Own and enhance quality metrics including automated coverage growth, escaped defects, test execution performance, flakiness rates, and release confidence.

• Empower developers to write, execute, and maintain automated tests as part of their daily routines.

• Expand automated regression coverage for the team.

• Decrease manual testing efforts from sprint to sprint.

• Develop reusable automation components that are adopted by multiple teams.

• Showcase effective utilization of AI agents to expedite automation development and maintenance.

• Enhance release confidence while facilitating rapid, reliable software delivery.

• Foster a culture where quality is a shared responsibility of the entire engineering team.

⛳️ Requirements

• Solid software engineering fundamentals, with the capability to review, validate, and debug code across various modern programming languages.

• Extensive experience with contemporary test automation frameworks, ideally Playwright.

• Proven ability to leverage AI coding agents as a primary development partner for generating, reviewing, debugging, refactoring, and maintaining code.

• Comfortable assigning significant portions of implementation tasks to AI agents while upholding high engineering and quality standards.

• Experience in constructing and maintaining scalable automation frameworks.

• Familiarity with integrating automated test suites into CI/CD pipelines using GitHub Actions or similar tools.

• Experience with agentic testing frameworks, AI-powered testing tools, or LLM API integrations within engineering workflows.

• Demonstrated success in increasing automation coverage, decreasing manual effort, and enhancing software quality outcomes.

• Strong grasp of quality engineering principles, test strategy, risk analysis, and defect prevention.

• Comfortable working as an embedded engineer within cross-functional product teams.

• Excellent communication skills with the ability to provide concise, actionable updates and collaborate effectively across teams.

• A sense of curiosity, adaptability, and a growth mindset towards emerging AI technologies and engineering practices.

• Experience testing AI-driven products, agents, or LLM-based applications.

• Familiarity with designing evaluation frameworks for AI-generated outputs.

• Knowledge of prompt engineering, AI quality assessment, and AI observability.

• Experience in performance, load, or resilience testing.

• Familiarity with test management platforms integrated with Jira.

• Experience in building internal developer platforms, testing tools, or engineering productivity solutions.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Flexible working hours and remote work opportunities.

• Professional development and training programs.

• Comprehensive health and wellness benefits.

• Collaborative and inclusive company culture.