Quality Assurance Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Evaluate software applications developed or modified by the Application Development team.

• Carry out structured peer and code reviews of testing artifacts.

• Develop, create, and sustain realistic and compliant test data sets, including PHI-safe synthetic healthcare data.

• Design and implement validation strategies for AI/ML and RAG features.

• Engage in test planning, execution tracking, defect management, and reporting processes.

• Provide insights on release readiness criteria to Engineering and Product stakeholders.

• Maintain the regression suite after each release.

• Create and uphold automated test suites in Python and JavaScript/Node.js integrated into CI/CD pipelines.

• Compose and review complex SQL queries, joins, and aggregations to ensure data accuracy and reconciliation.

• Verify data flows across source systems, transformation layers, and reporting/consumption layers.

• Formulate and execute test strategies for AI/ML, RAG pipelines, and AI-assisted features.

• Construct and maintain automated evaluation harnesses and datasets for AI/ML features.

• Validate applications, APIs, and testing environments deployed both on-premises and in Microsoft Azure.

• Analyze and interpret source code in React, Node.js, Python, and ColdFusion, as well as pull requests and technical designs.

• Write comprehensive test cases and test plans that trace to code paths, business rules, and acceptance criteria.

• Collaborate with developers during code reviews to identify gaps in coverage, untested branches, and high-risk changes.

• Conduct post-deployment validation in production environments.

• Investigate production defects and data issues, perform root cause analysis, and drive resolution with the Engineering team.

⛳️ Requirements

• Over 5 years of experience in automated software testing.

• Over 5 years of experience in manual software testing.

• Over 5 years of experience in component-level testing.

• Over 5 years of experience in end-to-end testing.

• Strong proficiency in SQL.

• Strong proficiency in React.

• Strong proficiency in Node.js.

• Strong proficiency in Python source code in GitLab.

• Proven proficiency in testing Artificial Intelligence (AI).

• Proven proficiency in testing Machine Learning (ML).

• Proven proficiency in evaluating Artificial Intelligence (AI).

• Proven proficiency in evaluating Machine Learning (ML).

• Proven proficiency in testing Retrieval-Augmented Generation (RAG).

• Proven proficiency in testing generative AI features.

• Proven proficiency in testing workloads on Microsoft Azure.

• High School Diploma is required.

• Ability to pass a background check before starting employment.

• Newly hired employees must undergo a drug screen.

• Agreement to necessary Compliance Regulations on the first day of employment.

• Compliance with applicable HIPAA regulations and company policies regarding confidentiality, privacy, and security of sensitive health information.

🏝️ Benefits

• A competitive compensation package.

• Healthcare, vision, and dental insurance.

• A generous 401(k) matching program.

• Paid vacation, PTO, and holidays.

• Opportunities for growth and training.

• An award-winning remote work environment.