QA Automation Engineer

Posted 11 hours ago

This is a fully remote position, open to applicants in Colombia.

📋 Description

• Develop a strategy for automation and quality infrastructure, incorporating Playwright-based frameworks that are accessible to all engineers.

• Take full ownership of the CI/CD quality pipeline from start to finish, including aspects like sharding, parallelization, flake SLOs, artifact collection, and monitoring post-deployment.

• Create dashboards to track test health, flakiness, coverage trends, and mean time to detection.

• Implement contract testing, performance testing, synthetic monitoring, and chaos engineering based on identified risks.

• Establish test strategies and standards, focusing on test pyramid balance, coverage targets, and prioritization based on risk.

• Design test data and environment isolation to ensure deterministic testing at scale.

• Conduct agent-based test development and triage loops with limits enforced by software.

• Develop evaluation and regression frameworks for features powered by AI.

• Enhance release processes and quality gates.

• Lead quality reviews following incidents and automate and monitor systemic improvements.

• Advocate for quality in architectural and product decision-making.

• Work collaboratively with Product, Platform, Customer Success, and engineering teams, utilizing quality metrics to inform investment decisions.


⛳️ Requirements

• 4 to 7 years of professional experience in software or test engineering.

• Bachelor’s degree in Computer Science, Engineering, or a related discipline.

• Proven history of designing and building Playwright-based test automation frameworks that are widely adopted by fellow engineers.

• Experience managing a CI/CD quality pipeline, encompassing parallelization, flake management, and post-deployment monitoring.

• Experience in defining test strategies for complex software systems, emphasizing risk-based prioritization and measurable quality indicators.

• Proficient in AI: able to write specifications with acceptance checks prior to task delegation to an agent, evaluate results against evidence, and maintain task state outside the context window.

• Strong analytical and problem-solving capabilities with a commitment to delivering high-quality software.

• Preferred: AI proficiency in executing parallel agent loops within a harness, with evaluations conducted in CI and reusable checks developed from past failures.

• Preferred: experience in constructing evaluation and regression frameworks for AI-driven features or non-deterministic system outputs.

• Preferred: familiarity with contract testing, synthetic monitoring, or chaos engineering.

• Preferred: expertise in performance and load testing tools.

• Preferred: experience mentoring test engineers and promoting quality practices across multiple teams.

• Preferred: knowledge of Jira, Azure DevOps, or TestRail.


🏝️ Benefits

• Equal opportunity employer.

• Recruitment-process accommodations available upon request.

People also viewed

ITGoals10 hours ago

DevOps Engineer – Automation

EG flagEgypt OnlyFull-timeQA Automation Engineer
ApplyView job
Bask Health11 hours ago

Senior Pharmacy Process – Automation Engineer

US flagUnited States OnlyFull-timeQA Automation Engineer
ApplyView job
Wabtec Corporation12 hours ago

Automation Engineer – Advanced Manufacturing

US flagPennsylvania OnlyFull-timeQA Automation Engineer$68.9k – $98.2k/year
ApplyView job
The Home Depot18 hours ago

DC Engineer, Automation and Engineering

US flagWashington OnlyFull-timeQA Automation Engineer$70k – $150k/year
ApplyView job
Worky.mx19 hours ago

AI Automation Engineer

MX flagMexico, +1 more countryFull-timeQA Automation Engineer
ApplyView job
ISI19 hours ago

Integration & Automation Engineer – AI & Automation

US flagVirginia OnlyFull-timeQA Automation Engineer
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers