Mid-Level Systems Quality Analyst

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Develop and implement testing strategies for AI agents, MCP servers, and APIs.

• Conduct functional, integration, regression, and performance testing.

• Create and sustain automated unit, integration, and end-to-end tests.

• Assess AI agent responses and behaviors, focusing on prompt scenarios, hallucinations, and edge cases.

• Trace bugs back to their root causes.

• Suggest or execute minor code fixes in collaboration with the development team.

• Record test cases, evidence, and quality reports.

• Work alongside developers, AI engineers, and product managers throughout the development process.

⛳️ Requirements

• Prior experience as a QA professional or Test Analyst, engaged in both manual and automated testing.

• Capability to read and comprehend code, with the independence to suggest or implement minor adjustments and fixes.

• Proficient in Git version control.

• Strong analytical skills and technical curiosity to examine the non-deterministic behavior often present in AI systems.

• Experience in testing LLM-based systems, AI agents, or chatbots.

• Knowledge of the MCP (Model Context Protocol) or integrations with AI-powered tools.

• Experience in load and performance testing for APIs.

• Familiarity with CI/CD processes, including GitHub Actions and GitLab CI.

🏝️ Benefits

• Fully remote work environment.

• Comprehensive health insurance.

• Dental coverage.

• IOB Benefits Card.

• Childcare support.

• Life insurance coverage.

• Internet allowance.

• Profit-sharing plan (PLR).

• Collaborations with educational institutions.

• Access to an Assessment and Development Platform.

• Opportunities for training and professional development.

• A culture that encourages continuous feedback.