QA/Test Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Become part of an innovative AI initiative dedicated to developing the next generation of evaluation benchmarks for cutting-edge AI models.

• Ensure that each benchmark is trustworthy, reproducible, and precisely assesses genuine AI capabilities.

• Analyze intricate, multi-step evaluation tasks, confirm their accuracy, identify edge cases, and enhance testing methodologies prior to benchmark deployment.

• Work collaboratively with AI researchers and task authors to elevate evaluation quality, remove ambiguity, and maintain benchmark integrity.

⛳️ Requirements

• A Master's degree, PhD, or equivalent practical experience in a STEM field that includes software engineering, research, or advanced technical problem-solving.

• At least 1 year of professional experience in Quality Assurance, Test Engineering, Software Engineering, Research Engineering, or a related technical area with a strong sense of quality ownership.

• Demonstrated experience in designing test cases, validating complex software systems, and debugging comprehensive workflows.

• Advanced proficiency in Python and Git, with the capability to troubleshoot unfamiliar codebases and technical settings.

• Outstanding analytical thinking, problem-solving abilities, and remarkable attention to detail.

• Experience in documenting bugs, test strategies, and technical observations with clear written communication.

• Preferred experience in evaluating AI systems, machine learning models, or AI-generated outputs.

• Capacity to work independently while managing various complex tasks with minimal supervision.

• Commitment to approximately 35 hours per week on a regular basis.

🏝️ Benefits

• Opportunity to work on pioneering projects at the forefront of AI technology.

• Collaborative and innovative work environment with a focus on professional development.

• Flexible working hours to accommodate personal schedules.

• Competitive compensation and benefits package.