Test Lead – AI Validation, Integration

This is a fully remote position, open to applicants in Poland.

📋 Description

• Take ownership of and implement a comprehensive Testing and AI Validation Strategy.

• Establish testing methodologies for functional, end-to-end (E2E), integration, regression, and user acceptance testing (UAT).

• Address non-functional needs and ensure testing aligns with standards such as GDPR, HIPAA, and HITRUST.

• Create validation plans, correctness criteria, success thresholds, and assessment techniques for AI components.

• Manage AI hallucinations and grounding rules effectively.

• Organize testing environments across Development, Testing, and Production.

• Develop a test data strategy for standard scenarios, edge cases, and ingestion failures.

• Conduct functional, regression, exploratory, performance, and load testing.

• Facilitate joint end-to-end validation with the client team for Salesforce integration.

• Incorporate testing activities into the Continuous Integration/Continuous Deployment (CI/CD) pipeline.

• Oversee Jira test case structures in alignment with user stories and acceptance criteria.

• Present QA metrics, including defect ratios.

• Validate a data validation and automation engine that processes both structured and unstructured inputs.

• Collaborate with the client on a regulated AI and Salesforce integration initiative.

⛳️ Requirements

• Proficiency in English.

• Experience in defining end-to-end testing strategies for complex solutions.

• Proven track record in designing and executing E2E tests for sophisticated, integrated systems using modern testing technologies.

• Demonstrated ability to validate AI models.

• Experience in managing test data across Development, Testing, and Production environments.

• Ability to establish traceability linking requirements, test cases, evidence, defects, and release decisions.

• Experience in testing non-functional requirements, including performance, reliability, auditability, and basic security.

• Strong comprehension of privacy and sensitive data management, including PII/PHI minimization and masking/anonymization techniques.

• Practical automation experience with at least one robust stack, such as Python, Java, or JavaScript with pytest/JUnit or similar frameworks.

• Competence in tracking and reporting QA metrics, including defect ratios.

• Effective written and verbal communication skills.

• Proficiency in Jira.

• Availability for full-time work with overlapping hours from 14:00–18:00 for collaboration with a client based in the USA.

• Familiarity with the AWS platform.

• ISTQB or equivalent certification.

• Prior experience in high-paced consulting or client-facing projects.

🏝️ Benefits

• Opportunity for remote work.

• Full-time availability required.

• No paid leave or benefits provided under the B2B arrangement.

• Must use own computer or equipment.