Software Quality Assurance Analyst

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Analyze the behavior of LLMs to create test scenarios that guarantee the accuracy, consistency, and safety of AI responses.

• Perform functional and automated testing on conversational flows and APIs to ensure stability in delivery for clients.

• Develop validation routines for generative models to reduce hallucinations and ensure alignment with business contexts.

• Detect integration anomalies and provide detailed reports, working with engineers to speed up fixes and enhancements.

• Assess the usability and response times of AI-driven journeys to facilitate a seamless and frictionless user experience.

• Collaborate with engineers and designers on the Professional Services team to validate LLM-powered conversational flows for enterprise clients.

⛳️ Requirements

• Hands-on experience in creating and executing functional, exploratory, and regression tests for intricate software workflows.

• Practical experience in test automation using industry-standard frameworks like Cypress or Robot Framework for continuous delivery pipelines.

• Capability to translate anticipated AI and LLM behavior into detailed test scenarios that ensure safe and accurate interactions.

• Experience in testing RESTful APIs using tools such as Postman to validate integrations and data traffic.

• Proficiency in utilizing generative AI and modern tools like GitHub Copilot to enhance script creation and expedite troubleshooting.

• Practical skills in working with cloud environments and querying data in both relational and non-relational databases.

• Experience in Agile settings, ensuring strategic communication and technical alignment with various stakeholders.

🏝️ Benefits

• No additional benefits, perks, or compensation are specified in the posting.