AI Test Engineer, III

This is a fully remote position, open to applicants in United States.

📋 Description

• Create, develop, and uphold automated testing suites across API, UI, security, and performance/load testing.

• Generate end-to-end and integration tests utilizing Playwright or similar contemporary frameworks.

• Write API tests for REST/GraphQL services, ensuring the validation of contracts, error management, and edge cases.

• Construct and sustain reliable, maintainable UI automation.

• Incorporate test suites into CI/CD pipelines for ongoing automated validation.

• Leverage AI-driven coding and testing tools to create, refactor, and scale tests.

• Establish secure and efficient methodologies and best practices for AI assistants in testing.

• Assess new AI testing tools and integrate valuable tools into the team's toolkit.

• Conduct security-focused testing encompassing authentication, authorization, input validation, and prevalent OWASP risks.

• Design and execute load and performance tests to assess scalability, latency, and resilience.

• Identify bottlenecks and potential failure points while collaborating with Engineering on remediation strategies.

• Verify data integrity across APIs, pipelines, and integrations using SQL and data-validation methods.

• Test interactions among services, APIs, and downstream systems in distributed settings.

• Discover anomalies, regressions, and gaps throughout end-to-end workflows.

• Work closely with Engineering, QA, Product, and Operations teams.

• Engage in sprint planning, backlog refinement, and release validation processes.

• Contribute to testing standards, best practices, and documentation efforts.

• Assist in root cause analysis for defects and production-related issues.

• Undertake additional responsibilities as assigned and fulfill relevant compliance requirements.

⛳️ Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.

• Experience in QA automation, test engineering, or a comparable software engineering position.

• Practical experience with a modern test automation framework (Playwright is highly preferred; Cypress, Selenium, or similar are acceptable).

• Experience in testing APIs, distributed systems, and data pipelines.

• Strong comprehension of software testing principles and test automation design.

• Solid SQL and data-validation capabilities.

• Experience in integrating tests into CI/CD pipelines.

• Background in an Agile development setting.

• Familiarity with cloud-based systems, preferably AWS.

• Ability to analyze system behavior and pinpoint root causes.

• Experience in testing AI/ML models or data-driven systems.

• Experience validating outputs generated by AI or prompt-based systems.

• Knowledge of LLMs, agent workflows, or AI-assisted coding tools.

• Experience in healthcare or regulated-data environments, including HIPAA and compliance.

• Proficiency with CI/CD and DevOps pipelines.

• Experience utilizing AI-assisted coding/testing tools such as Claude Code or Copilot.

• Familiarity with security testing and/or performance/load testing tools such as k6, JMeter, or OWASP ZAP.

• Understanding of AI/ML concepts.

• Capability to work in proximity to computers and printers.

• Ability to perform sedentary work, including typing, repetitive computer-related motions, analytical focus, reading, and verbal/written communication.

• May be required to undergo background and drug screenings and disclose personal health information or personally identifiable information.

🏝️ Benefits

• Competitive salaries.

• Health insurance.

• 401(k) plan with employer matching.

• Paid parental leave.

• A collaborative and innovative work atmosphere.

• Reasonable accommodations for individuals with disabilities.

• Compliance-related accommodations and protections under the ADA and Title VII.