AI Test Engineer II

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, develop, and maintain automated testing suites for API, UI, security, and performance/load testing.

• Create end-to-end and integration tests utilizing Playwright or other comparable modern frameworks.

• Write REST/GraphQL API tests to validate contracts, error handling, and edge scenarios.

• Establish and maintain reliable, manageable UI automation.

• Integrate test suites into CI/CD pipelines to ensure continuous automated validation.

• Leverage AI-driven coding and testing tools for generating, refactoring, and scaling tests.

• Develop safe and effective practices for integrating AI assistants into testing workflows.

• Assess emerging AI testing tools and integrate valuable solutions into the team's toolkit.

• Conduct security testing that encompasses authentication, authorization, input validation, and common OWASP vulnerabilities.

• Design and execute load and performance tests to assess scalability, latency, and resilience.

• Identify bottlenecks and failure points, collaborating with Engineering on remediation efforts.

• Ensure data integrity across APIs, pipelines, and integrations using SQL and validation techniques.

• Test interactions among services, APIs, and downstream systems within distributed environments.

• Identify anomalies, regressions, and gaps throughout end-to-end workflows.

• Work collaboratively with Engineering, QA, Product, and Operations teams.

• Engage in sprint planning, backlog refinement, and release validation activities.

• Contribute to the development of testing standards, best practices, and documentation.

• Assist in root cause analysis for defects and production issues.

⛳️ Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience.

• Experience in QA automation, test engineering, or a related software engineering position.

• Practical experience with a modern test automation framework (Playwright is highly preferred; Cypress, Selenium, or similar frameworks are acceptable).

• Experience in testing APIs, distributed systems, and data pipelines.

• Strong grasp of software testing principles and test automation design.

• Proficient SQL and data-validation skills.

• Familiarity with integrating tests into CI/CD pipelines.

• Experience working within an Agile development environment.

• Knowledge of cloud-based systems, preferably AWS.

• Ability to analyze system behavior and pinpoint root causes.

• Experience in testing AI/ML models or data-driven systems.

• Experience in validating AI-generated outputs or prompt-based systems.

• Understanding of LLMs, agent workflows, or AI-assisted coding tools.

• Experience in healthcare or regulated data environments, including HIPAA compliance.

• Proficiency with CI/CD and DevOps pipelines.

• Experience using AI-assisted coding/testing tools like Claude Code or Copilot in actual testing workflows.

• Familiarity with security testing and/or performance/load testing tools such as k6, JMeter, or OWASP ZAP.

• Understanding of AI/ML concepts.

• Ability to work in proximity to computers and printers in an indoor office setting.

• Capability to perform sedentary work, typing, and repetitive computer-related tasks.

• Ability to focus on analytical tasks and communicate effectively both verbally and in writing.

• May be required to undergo background and drug screenings and provide health or personally identifiable information to meet compliance requirements.

🏝️ Benefits

• Competitive salaries.

• Health insurance.

• 401(k) plan with employer match.

• Paid parental leave.

• Collaborative and innovative work environment.

• Reasonable accommodations for individuals with disabilities.