Senior QA Automation Engineer – AI Applications

This is a fully remote position, open to applicants in United Kingdom.

📋 Description

• Design and sustain automated testing suites, evaluation scenarios, metrics, and datasets for AI-integrated features.

• Automate quality assurance workflows utilizing Python and CI/CD (such as GitHub Actions and Jenkins), employing AI-driven testing tools to enhance test development, upkeep, and coverage.

• Develop and uphold test harnesses for AI services, applications, and APIs.

• Execute API testing for AI services and backend systems.

• Establish quality strategies and acceptance criteria for AI-driven applications encompassing functional, API, integration, and AI/ML features.

• Assess AI/ML applications and machine learning models from both product and user perspectives.

• Analyze AI/ML model outputs for accuracy, consistency, and anticipated application behavior.

• Create structured rubrics that convert qualitative insights into quantifiable evaluation metrics.

• Develop quality gates for CI/CD and deployment pipelines, incorporating automated regression and integration testing.

• Guide teams on QA automation best practices and uniform quality standards for AI-driven applications.

• Collaborate on multi-team projects and codebases, ensuring code quality and coherence.

• Engage in code reviews and offer constructive feedback to colleagues.

• Document and share insights and ideas across the organization.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Engineering, or related field.

• Over 5 years of professional experience in software quality assurance, test automation, or software engineering.

• Strong programming capabilities in Python, with a background in test automation.

• Practical experience with AI-driven testing tools or AI coding assistants to enhance test automation, productivity, and quality.

• Familiarity with CI/CD tools and methodologies.

• Knowledge of popular CAD environments and related tools.

• Proficient in automation and UAT test suites/frameworks.

• Experience in designing QA frameworks or platforms utilized by multiple teams.

• Exceptional problem-solving abilities and meticulous attention to detail.

• Strong communication and teamwork skills.

• Comprehension of software architecture and design patterns.

• Capability to thrive in an Agile development environment.

🏝️ Benefits

• Comprehensive benefits package.