AI-Enabled QA Engineer

This is a fully remote position, open to applicants in Egypt, +4 more countries.

📋 Description

• Evaluate tools that assist in acquisitions, financial analysis, approval workflows, and marketing operations.

• Develop automated checks for interfaces and underlying systems utilizing Playwright, Cypress, Selenium, pytest, or similar frameworks.

• Construct test cases employing equivalence classes, boundary values, negative scenarios, and frequently overlooked situations.

• Execute tests within CI pipelines.

• Monitor and categorize defects using Jira, Linear, or Azure DevOps.

• Produce actionable bug reports.

• Independently confirm data integrity with SQL through joins, aggregation, and detailed record analysis.

• Verify row counts, detect duplicates, identify orphaned records, maintain referential integrity, and reconcile totals.

• Conduct API testing using Postman or code, encompassing status codes, payload structures, authentication failures, and repeated requests.

• Assess AI-generated outputs with fixed examples, golden sets, precision and recall metrics, regression tests, and fabricated-fact verifications.

• Trace extracted financial-statement fields and AI-generated summaries back to their source documents.

• Test document extraction scenarios, including scanned documents, rotated pages, and missing signatures.

• Evaluate diligence data-room edge cases, including duplicate uploads, absent documents, and seemingly complete yet incomplete rooms.

• Test notifications for necessary triggers and unnecessary alerts.

• Assess approval controls to prevent unreviewed submissions and bypasses.

• Create regression test cases for AI-generated outputs.

• Review generated brand assets across eight to ten brands to ensure correct names, logos, and colors while preventing cross-brand contamination.

• Collaborate with the Product Manager and Head of IT to develop a production-ready checklist.

• Implement the checklist on the first tool.

• Set up testing standards for acquisition, financial analysis, approval workflow, and brand asset tools.

• Complete the application form and produce a skills-showcase video.

⛳️ Requirements

• Minimum of 3 years of QA experience in both manual and automated testing environments.

• Proven experience testing data-intensive applications rather than solely user interfaces.

• Proficiency in test automation using code.

• Systematic experience in evaluating AI-generated outputs.

• Background in data validation and API testing.

• Practical knowledge of using Playwright, Cypress, or Selenium for interface testing.

• Competence in pytest or equivalent for automated testing.

• SQL proficiency for joins, aggregation, and independent data verification.

• Capability to test APIs using Postman or code.

• Strong skills in test case design, including equivalence classes, boundaries, negative cases, and overlooked scenarios.

• Ability to validate row counts, identify duplicates, orphaned records, referential integrity, and carry out data reconciliation.

• Expertise in evaluating AI output using golden sets, precision and recall, regression testing, and fabricated-fact checks.

• Capacity to test document extraction and trace extracted information back to source documents.

• Proficient in executing automated tests via CI pipelines.

• Ability to track and manage defects using Jira, Linear, or Azure DevOps.

• Skill in crafting clear, actionable bug reports.

• Understanding that AI-generated outputs can fail confidently, plausibly, and inconsistently.

• Ability to document processes and establish testing standards.

• Must be able to work during U.S. business hours aligned with the client’s time zone, overlapping U.S. Eastern business hours until 5:00 PM ET.

• English resume is mandatory; English proficiency details are required during application.

• Experience in testing document-heavy or extraction-focused systems is advantageous.

• Familiarity with checking creative or brand outputs for consistency is a plus.

• Background in healthcare data is beneficial.

• Experience in finance or accounting testing is advantageous.

• Test automation experience within a Microsoft environment is beneficial.

• Having created a definition of done that the organization adopted is a plus.

• Skills in performance testing, synthetic test-data generation, accessibility checks, and Power Platform testing are beneficial but not mandatory.

🏝️ Benefits

• Fully remote work setup.

• Opportunity to collaborate directly with engineers, the Product Manager, M&A and marketing leads, and the Head of IT.

• Chance to establish testing standards and define production-readiness criteria.