Test Harness Engineer

This is a fully remote position, open to applicants in Argentina.

📋 Description

• Design and enhance AI-driven test harnesses where agents plan, execute, validate, and analyze testing scenarios.

• Integrate large language models such as OpenAI, Claude, Gemini, or similar with tools, APIs, and automation frameworks, including evaluations and safeguards to prevent false positives.

• Develop and sustain automated UI, API, and integration test suites that operate reliably within CI/CD pipelines.

• Translate Jira acceptance criteria and Figma designs into comprehensive test plans, conducting exploratory, regression, and functional testing across QA and UAT.

• Identify and report defects with clear reproduction steps and supporting evidence, facilitating triage discussions with developers and product teams.

• Leverage AI tools to expedite test design and failure analysis while critically validating their outputs.

• Mentor engineers on harness design and automation methodologies.

• Make architectural and tooling decisions, taking ownership of quality from the design phase to release.

⛳️ Requirements

• Demonstrated experience in software engineering or test automation, particularly in designing QA automation frameworks that teams depend on in production environments.

• Practical experience in developing AI agents or agent-based workflows, including tool/function calling, context management, and prompt engineering.

• Familiarity with at least one agent orchestration framework (LangGraph, LangChain, CrewAI, or similar).

• Capability to implement evaluation, validation, and guardrail mechanisms for AI-driven test execution.

• Proficient in JavaScript/TypeScript, with a working understanding of Python or Java.

• Practical experience with UI and API test automation tools (e.g., Cypress, Playwright, REST Assured, Postman/Newman, Karate).

• Experience in testing REST APIs and asynchronous, event-driven systems (message queues, pub/sub, or similar).

• Experience with SQL or NoSQL databases for setting up and validating test data.

• Experience in integrating automated tests into CI/CD pipelines.

• Proficient in English.

• Senior-level autonomy: you make informed decisions with minimal oversight and drive solutions from start to finish.

• Strong analytical skills with a risk-based perspective, and effective communication with developers and product teams.

• Practical approach to determining what to automate versus what to test exploratorily.

• Commitment to continuous learning and development for yourself and others.

🏝️ Benefits

• Full-time employment

• Remote work arrangement