
QA Automation Engineer / SDET – AI Prototyping
Posted 1 day ago

Posted 1 day ago
This is a fully remote position, open to applicants in Qatar, +1 more country.
• Develop and implement a practical, risk-focused testing strategy for multiple prototypes being built simultaneously.
• Create reusable automated tests for APIs, user interfaces, and generated documents, integrating them into CI workflows.
• Collaborate with the on-site Product Owner and the client's engineers to maintain versioned reference (golden) datasets.
• Design validation checks for AI outputs, including schema validation, defined acceptance criteria, and regression tracking.
• Prefer the use of deterministic checks for calculations and code compliance, ensuring they remain separate from the code being tested.
• Utilize AI-assisted test generation, while thoroughly reviewing and taking ownership of the tests produced.
• Enhance regression test suites following defects or feature modifications, executing them prior to refactoring efforts.
• Provide reports on test coverage, known limitations, and release risks, while assisting developers with shared fixtures and tools.
• Become part of a six-member team developing AI tools for a major electrical contractor on behalf of a US-based SaaS company.
• Minimum of 5 years in QA automation or as a Software Development Engineer in Test (SDET).
• Proficient in test automation using TypeScript and/or Python.
• Experience in API and integration testing; familiarity with Playwright (or similar tools) for UI automation.
• Ability to integrate automated tests into CI pipelines, with effective fixture and test-data management practices.
• Practical experience utilizing AI tools for test generation, with a critical evaluation of the generated outputs.
• Capable of making risk-based decisions regarding what to test rigorously and what to avoid over-testing in prototypes.
• Proficient in English.
• Must be available to work core hours aligning with US Central Time.
• Experience in evaluating LLM or other AI outputs (evaluation sets, scoring, regression).
• Familiarity with testing document outputs like PDFs, spreadsheets, or generated reports.
• Exposure to the engineering, construction, or CAD/BIM data sectors.
• Experience with applications hosted on AWS.
• Knowledge of engineering codes or domains related to regulation and safety.
• Exceptional work environment recognized by Great Place To Work.
• A multicultural organization experiencing continuous growth.
• Engagement period of 6 MONTHS.
CACI International Inc
Helpware
mpathic
Leidos
Get handpicked remote jobs straight to your inbox weekly.