Senior QA Automation Engineer, Python, Selenium, Pytest

This is a fully remote position, open to applicants in Guatemala.

📋 Description

• Develop a comprehensive testing architecture that includes planning for unit, integration, end-to-end, and semantic validation test suites to encompass the entire pipeline from profile intake to roadmap generation; establish coverage targets and acceptance criteria.

• Create semantic validation harnesses for AI outputs by designing golden-set test cases (5–8 CISO-approved reference profiles) that evaluate AI stage precision/recall, rigor-tier correctness, floor-control invariants, traceability completeness, and run-to-run stability; include a semantic regression block for merges.

• Execute access-control testing by designing automated probes at the API and database layers to ensure cross-tenant isolation; simulate compromised sessions to verify that RLS policies enforce tenant boundaries.

• Design and sustain CI/CD quality gates by creating automated test runners that operate on every commit: unit tests, integration tests, schema validation, migration guards, image scanning, and access-control probes; prevent merge of red builds.

• Direct test automation practices by enhancing automation frameworks and methodologies; identify areas for improvement in test processes; suggest tools and technologies to enhance testing efficiency.

• Collaborate with the team by acting as the QA representative during technical design reviews; identify testability concerns early; work alongside the AI/LLM Lead to clarify what "correct" signifies for each pipeline stage.

• Mentor junior test engineers by guiding them in test design, semantic validation, and CI/CD best practices; share insights on testing AI systems where reproducibility is vital.

• Manage test documentation and reporting by maintaining clear test plans, results, and traceability matrices; communicate test coverage and quality metrics to leadership; transparently report blockers and risks.

⛳️ Requirements

• Over 5 years of hands-on experience in software QA with a proven record of:

• Developing test strategies, planning, execution, and maintenance.

• Creating comprehensive test documentation and ensuring traceability.

• Advanced test automation experience (custom frameworks, advanced scripting).

• Over 3 years of experience with automated testing tools such as Selenium, Pytest, or equivalent; capability to write custom testing frameworks.

• Advanced proficiency in a programming language relevant to test automation, such as:

• Python (primary for this role; Pytest, async testing).

• Or Java, C#, Go.

• In-depth knowledge of databases and SQL to perform complex data validations, ensure multi-tenant isolation at the database level, and test RLS policies.

• Expertise in CI/CD pipelines, including understanding how tests fit into automated deployment workflows; experience in optimizing test execution for speed and reliability.

• Familiarity with Agile/Scrum methodologies and the ability to guide QA strategies in fast-paced, iterative development cycles.

• Proficiency in defect tracking tools (Jira or equivalent).

• Demonstrated leadership skills by mentoring junior engineers, advocating for quality standards, and driving process enhancements.

• Exceptional communication abilities to articulate complex technical issues to engineers, product teams, and stakeholders.

• Self-driven and detail-oriented; capable of working independently under pressure and managing multiple priorities.

• Excellent command of English to collaborate effectively with distributed, global teams.

🏝️ Benefits

• Medical Insurance benefits as per company policy.

• Life Insurance in accordance with company policy.

• 15 days of paid vacation, sick leave, and paid holidays as mandated by local law.

• Paternity and maternity leave as per local regulations.

• Marriage, bereavement, and graduation leaves according to company policy.

• Sick leave and paid holidays in compliance with local law.

• Christmas and mid-year bonuses based on local legal standards.

• Monthly productivity bonuses as stipulated by local law.

• Discounts available at local shops.

• Direct payroll deposit.

• Coverage for paid professional certifications.