Senior Testing Engineer

This is a fully remote position, open to applicants in Colombia.

📋 Description

• Create and implement scalable automation frameworks for UI, API, and integration testing.

• Incorporate automated tests into CI/CD pipelines and enhance CI/CD quality gates.

• Develop AI-focused testing strategies and assess ML models based on accuracy, precision, recall, bias, and drift.

• Evaluate data pipelines and feature engineering processes; verify LLM outputs for hallucination risk and consistency.

• Conduct test planning, oversee automation code reviews, and uphold best practices within the test codebase.

• Track model performance in production and assist in release validation and quality assurance procedures.

• Utilize AI-driven tools such as Claude, Cursor, and other contemporary AI assistants to ensure high-quality deliverables.

• Collaborate with developers, ML engineers, DevOps, and product teams throughout the entire SDLC.

• Relay quality status, testing insights, and risks to stakeholders effectively.

• Engage in sprint ceremonies, design evaluations, and release planning activities.

• Spearhead quality initiatives with increasing responsibility for testing strategy and automation architecture.

• Contribute to QA standards and best practices while enhancing coverage, reliability, and automation.

• Guide junior engineers and facilitate their professional development.

⛳️ Requirements

• 3–4+ years of experience in QA, data QA, or AI testing.

• Strong understanding of both automation and AI testing principles.

• Proficient programming skills in Python and at least one additional language, such as Java or JavaScript.

• Practical experience in designing and maintaining automation frameworks.

• In-depth knowledge of the ML lifecycle and model evaluation metrics, including accuracy, precision, recall, bias, and drift.

• Familiarity with AI testing methodologies, including LLM validation, hallucination testing, and data pipeline validation.

• Experience working with CI/CD pipelines, API automation, and version control systems.

• Knowledge of MLOps pipelines and model monitoring in production settings.

• Strong grasp of Agile methodologies.

• Experience with test management tools such as Jira and TestRail.

• Proven experience utilizing AI-driven tools like Claude and Cursor.

• Familiarity with mobile automation, performance testing, LLM testing frameworks, prompt engineering, or cloud ML platforms is a plus.

🏝️ Benefits

• Competitive salary and performance-based incentives.

• Opportunities for professional growth and development.

• Flexible working hours and remote work options.

• Collaborative and innovative team environment.

• Health, dental, and vision insurance plans.

• Retirement savings plan with company matching.