Senior Quality Assurance Engineer

This is a fully remote position, open to applicants in India.

📋 Description

• Ensure the quality of Provenir’s offerings

• Develop automated tests for microservices and associated front-end components

• Oversee builds and continuous integration processes

• Manage infrastructure across both development and production cloud environments

• Construct and maintain end-to-end and component test suites utilizing browser automation

• Design API, contract, and UI test coverage based on the test pyramid

• Integrate quality gates within CI/CD pipelines, including parallel executions and risk-based test selection

• Provision temporary containerized test environments through infrastructure-as-code

• Monitor test flake rates, isolate and resolve unstable tests, and uphold stability and runtime SLAs

• Leverage AI-assisted tools for test development, coverage gap assessment, and locator resilience

• Collaborate with engineers to adopt a shift-left approach and assist in issue triage and root-cause analysis

• Validate graph database schemas, relationships, queries, ingestion pipelines, and graph analytics outcomes

• Create evaluation harnesses for ML model behavior, focusing on drift, bias, fairness, and explainability checks

• Generate automated tests for agentic workflows, non-deterministic outputs, prompts, and model regressions

• Confirm feature pipelines and training/serving consistency in collaboration with data science teams

• Enhance dev/test/deploy workflows and facilitate application onboarding for build and release automation

• Document, monitor, and escalate issues

⛳️ Requirements

• A Bachelor’s Degree in Computer Science or a related discipline

• Proven extensive hands-on experience in the automated testing of web applications and services

• Experience in designing, developing, and executing automated tests using Python with Playwright, Selenium WebDriver, or similar tools

• Knowledge of maintainable test architecture, such as Page Object Model or comparable patterns

• Extensive practical experience with Python scripting

• Experience in testing web services and REST APIs utilizing Postman and Swagger

• Familiarity with graph databases like Neo4j, Amazon Neptune, TigerGraph, or JanusGraph, including the ability to write and validate graph queries

• Exposure to testing AI/ML-driven features and an understanding of probabilistic-system assertions

• Scripting experience in languages beyond Python, such as Unix shell or Ruby

• Experience with continuous integration and pipeline-based delivery using Jenkins, GitHub Actions, GitLab CI, or similar platforms

• Proficiency in SQL

• Experience in recommending process enhancements

🏝️ Benefits

• Comprehensive health and wellness programs

• Paid time off

• Company holidays

• Flexible and remote-friendly work options

• Maternity/paternity leave