
QA Automation Engineer
Posted 11 hours ago

Posted 11 hours ago
This is a fully remote position, open to applicants in Colombia.
• Develop a strategy for automation and quality infrastructure, incorporating Playwright-based frameworks that are accessible to all engineers.
• Take full ownership of the CI/CD quality pipeline from start to finish, including aspects like sharding, parallelization, flake SLOs, artifact collection, and monitoring post-deployment.
• Create dashboards to track test health, flakiness, coverage trends, and mean time to detection.
• Implement contract testing, performance testing, synthetic monitoring, and chaos engineering based on identified risks.
• Establish test strategies and standards, focusing on test pyramid balance, coverage targets, and prioritization based on risk.
• Design test data and environment isolation to ensure deterministic testing at scale.
• Conduct agent-based test development and triage loops with limits enforced by software.
• Develop evaluation and regression frameworks for features powered by AI.
• Enhance release processes and quality gates.
• Lead quality reviews following incidents and automate and monitor systemic improvements.
• Advocate for quality in architectural and product decision-making.
• Work collaboratively with Product, Platform, Customer Success, and engineering teams, utilizing quality metrics to inform investment decisions.
• 4 to 7 years of professional experience in software or test engineering.
• Bachelor’s degree in Computer Science, Engineering, or a related discipline.
• Proven history of designing and building Playwright-based test automation frameworks that are widely adopted by fellow engineers.
• Experience managing a CI/CD quality pipeline, encompassing parallelization, flake management, and post-deployment monitoring.
• Experience in defining test strategies for complex software systems, emphasizing risk-based prioritization and measurable quality indicators.
• Proficient in AI: able to write specifications with acceptance checks prior to task delegation to an agent, evaluate results against evidence, and maintain task state outside the context window.
• Strong analytical and problem-solving capabilities with a commitment to delivering high-quality software.
• Preferred: AI proficiency in executing parallel agent loops within a harness, with evaluations conducted in CI and reusable checks developed from past failures.
• Preferred: experience in constructing evaluation and regression frameworks for AI-driven features or non-deterministic system outputs.
• Preferred: familiarity with contract testing, synthetic monitoring, or chaos engineering.
• Preferred: expertise in performance and load testing tools.
• Preferred: experience mentoring test engineers and promoting quality practices across multiple teams.
• Preferred: knowledge of Jira, Azure DevOps, or TestRail.
• Equal opportunity employer.
• Recruitment-process accommodations available upon request.
ITGoals
Bask Health
Wabtec Corporation
The Home Depot
Get handpicked remote jobs straight to your inbox weekly.