QA Automation Developer

This is a fully remote position, open to applicants in Canada.

📋 Description

• Utilize testing principles and heuristics to identify product risks, edge cases, failure modes, and discrepancies in expected behavior.

• Examine failures and unexpected behaviors, taking appropriate action.

• Set up and utilize agentic tools to enhance test creation, maintenance, analysis, failure triage, and ongoing QA tasks.

• Promote testability and quality throughout the development lifecycle.

• Enhance the reliability, performance, and scalability of test frameworks, internal tools, and automated quality gates.

• Thoroughly assess AI-generated outputs while ensuring proper validation and human oversight.

• Contribute to testing strategies for AI-driven, LLM-based, and agentic product functionalities.

• Assist in defining evaluation methods for non-deterministic behaviors, including expected behavior, quality thresholds, regression strategies, and failure assessments.

• Validate model responses, tool utilization, grounding, consistency, error management, latency, and end-to-end agent behaviors.

• Work collaboratively with Engineering, Product, and other technical teams.

• Share testing methodologies, tools, and insights to enhance testing efficiency and delivery speed.

⛳️ Requirements

• Solid understanding of software testing fundamentals, encompassing critical thinking, exploratory testing, test design, risk-based testing, common testing heuristics, and evaluating customer and product impact.

• Practical experience in designing and developing automated tests for contemporary software applications.

• Proficient programming skills in at least one language typically used for test automation or engineering, such as TypeScript/JavaScript or Python.

• Familiarity with modern test automation frameworks.

• Experience with CI/CD pipelines and integrating automated testing into software delivery processes.

• Capability to troubleshoot complex software and automated test failures across application, test, data, and infrastructure layers.

• Hands-on experience utilizing AI-assisted development tools to enhance or automate engineering and QA workflows.

• Strong collaboration and communication abilities across QA, Engineering, Product, and other technical teams.

• A mindset focused on continuous improvement, with an interest in making software quality faster, more scalable, and more dependable.

• Meet the necessary requirements to undergo a full background check.

🏝️ Benefits

• Potential eligibility for bonus awards.