AI Test Engineer II

This is a fully remote position, open to applicants in United States.

📋 Description

• Assessing the quality, reliability, and safety of AI-driven systems throughout TREND's platform

• Testing and Validation of AI

• Create and implement testing strategies for AI/ML models, encompassing functional, regression, and scenario-based testing

• Confirm the accuracy, consistency, and reliability of outputs generated by AI

• Formulate test cases for edge cases, model drift, and scenarios involving unexpected behavior

• Assess model performance against established success criteria and business needs

• Test workflows driven by agents and validate interactions among AI agents, APIs, and downstream systems

• Identify failure points within end-to-end AI workflows and suggest improvements

• Ensure the completeness, accuracy, and bias risks of training, validation, and test datasets

• Conduct data validation testing across pipelines to maintain the integrity of inputs and outputs

• Collaborate with Data Engineering to identify anomalies

• Develop and sustain automated testing frameworks for AI-enabled systems

• Incorporate testing into CI/CD pipelines to facilitate continuous validation

• Assist in defining and validating guardrails for AI systems

⛳️ Requirements

• Bachelor’s degree in Computer Science, Data Science, Engineering, or a related field (or equivalent experience)

• Background in QA, testing, or a similar engineering role

• Experience in testing APIs, data pipelines, or distributed systems

• Solid understanding of software testing principles and test automation

• Experience in an Agile development environment

• Knowledge of AI/ML concepts (model evaluation, training vs inference, prompt behavior, etc.)

• Familiarity with test automation tools

• Strong SQL/data validation capabilities

• Experience with cloud-based environments (preferably AWS or Databricks)

• Ability to analyze system behavior and pinpoint root causes

🏝️ Benefits

• Competitive salaries

• Highly valued health insurance

• A 401(k) plan with employer match

• Paid parental leave

• Additional perks