Senior QA Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Develop and implement strategies for functional, integration, regression, and performance testing.

• Create and execute testing protocols for applications utilizing Artificial Intelligence and Large Language Models (LLMs).

• Evaluate the quality of AI-generated outputs based on criteria including accuracy, coherence, tone, safety, and bias.

• Design and sustain automated testing frameworks and test suites.

• Validate solutions that are integrated with Retrieval-Augmented Generation (RAG) pipelines, knowledge bases, and vector databases.

• Conduct testing for APIs, backend services, and inter-system integrations.

• Identify risks, defects, and edge cases pertaining to AI model functionality.

• Execute data integrity checks, reconciliation, and quality assessments.

• Oversee regression testing associated with releases, fixes, and infrastructure modifications.

• Collaborate with development, product, and business analysis teams to ensure the testability of solutions.

• Perform defect analysis and prioritize issues based on their business impact.

• Track quality metrics, test coverage, and levels of automation.

• Prepare executive summaries and recommendations for continuous improvement.

• Assist in production incident investigations and root cause analyses.

• Mentor team members and advocate for software quality best practices.

⛳️ Requirements

• Strong background in Software Quality Assurance (QA) or Quality Engineering.

• Proven experience in senior or technical QA leadership positions.

• Advanced or fluent English proficiency for effective daily communication.

• Familiarity with functional, integration, regression, and performance testing methodologies.

• Experience in test automation with tools like Selenium, Playwright, Robot Framework, or similar options.

• Knowledge of software development using Java and Python.

• Proficiency in API automation and validation techniques.

• Understanding of database queries, data validation, and reconciliation processes.

• Experience with CI/CD pipelines and tools such as Jenkins, GitHub, or comparable platforms.

• Knowledge of Large Language Model (LLM) architecture and functionality.

• Experience in Prompt Engineering and assessing AI-generated outputs.

• Familiarity with LangChain and/or LangGraph.

• Experience with Retrieval-Augmented Generation (RAG) pipelines.

• Understanding of vector databases and similarity search techniques.

• Knowledge of integration protocols and testing tools connected via MCP.

• Familiarity with methodologies for testing security, bias, and AI system validation.

• Preferred: experience in securitization, capital markets, or financial assets.

• Preferred: experience testing complex financial platforms.

• Preferred: advanced understanding of embeddings, tokenization, attention mechanisms, and LLM inference.

• Preferred: experience testing agentic solutions (AI Agents).

• Preferred: knowledge of monitoring AI model quality at scale.

• Preferred: experience in technical leadership and developing QA teams.

• Preferred: experience with AI and Machine Learning tools applied to test automation.

🏝️ Benefits

• Multi-benefit card – choose how and where to use it.

• Tuition assistance for undergraduate, graduate, MBA, and language courses.

• Certification incentive programs.

• Flexible working hours.

• Competitive salaries.

• Annual performance review with a structured career development plan.

• International career opportunities.

• Wellhub and TotalPass.

• Private pension plan.

• Childcare assistance.

• Medical insurance.

• Dental insurance.

• Life insurance.