AI Systems Quality Specialist

This is a fully remote position, open to applicants in Kansas.

📋 Description

• Design, develop, and sustain automation frameworks for functional, regression, and integration testing.

• Create automated test scripts for APIs, user interface workflows, data pipelines, and interactions with AI agents.

• Incorporate automated testing into CI/CD pipelines using Jenkins, GitHub Actions, or Cloud Build.

• Ensure comprehensive test coverage for platform functionalities and partner integrations, including Veeva Vault and Vertex AI.

• Develop and implement test cases for features, enhancements, bug fixes, regression, compliance, and validation.

• Assess the quality of AI outputs for accuracy, hallucination, tone, and compliance adherence.

• Manage integration testing for platform connectors and data flows.

• Create synthetic test environments and mock APIs.

• Validate ETL pipelines, analytics dashboards, and the accuracy of data.

• Monitor and report on latency, failure rates, and API response time metrics.

• Identify, prioritize, and manage defects using Jira.

• Collaborate on bug validation and root cause analysis.

• Lead post-release validation efforts and QA retrospectives.

• Maintain comprehensive test documentation, validation reports, evidence logs, dashboards, and reporting templates.

• Support audit readiness and traceability from requirements to release.

• Exhibit a strong commitment to diversity, equity, and inclusion.

⛳️ Requirements

• Over 7 years of experience in QA automation or software testing.

• At least 3 years of experience in a lead or senior testing role.

• Proficiency in Python, JavaScript, or .Net for automation scripting.

• Experience using PyTest and Selenium.

• Strong knowledge of API testing utilizing Postman.

• Experience in data validation with SQL, Snowflake, and BigQuery.

• Familiarity with testing integrated SaaS systems within cloud environments, preferably Google Cloud.

• Understanding of CI/CD and continuous testing methodologies.

• Exceptional skills in documentation, reporting, and communication with stakeholders.

🏝️ Benefits

• Competitive salaries and benefits.

• Reasonable accommodations during the interview and hiring process for qualified applicants with disabilities.

• An inclusive and diverse workplace culture.