AI Quality Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Create and implement AI-driven solutions for customer modernization scenarios.

• Develop and merge AI functionalities into current systems and workflows.

• Set up and uphold quality assurance frameworks, including test plans, acceptance criteria, and regression suites.

• Validate AI-generated code, capabilities, and agents prior to their promotion through the innovation pipeline.

• Lead the development of reusable AI skills and agents for customer modernization initiatives.

• Focus on automated testing, security scanning, data sensitivity, and scalability.

• Collaborate with DevOps engineers to design and manage long-running, multi-agent workflows.

• Ensure reliability, observability, and recoverability within production environments.

• Assist the innovation pipeline in transitioning AI-generated prototypes from sandbox concepts into secure, enterprise-level applications.

• Review and perform quality checks on prototype outputs for accuracy, reliability, and adherence to standards.

• Monitor AI-assisted development outputs for accuracy, reliability, and compliance drift.

• Provide feedback to Value Engineers and AI Engineers to enhance prompts, skills, and agents.

• Support federal customer modernization objectives by automating and optimizing servicing operations, minimizing manual processing, enhancing data quality, aligning with modernization standards, and strategizing for the retirement of legacy platforms.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent professional experience.

• Proven experience in software quality assurance, test engineering, or a related field, including test plan design and defect management.

• Practical experience in testing or validating AI-generated code, prototypes, or “vibe-coded” solutions for accuracy and reliability.

• Experience with automated testing tools and frameworks (e.g., Selenium) across web and enterprise applications.

• Familiarity with Salesforce, AWS (including Lambda and Redshift), Java, PostgreSQL, or a similar enterprise technology stack.

• Understanding of CI/CD pipelines and quality gates within contemporary software delivery practices.

• Capability to identify security, data-sensitivity, and compliance risks in AI-assisted solutions.

• Strong written and verbal communication skills with the ability to collaborate across product, engineering, data, and business SME teams.

• Must be a U.S. citizen.

• Eligible to obtain and maintain a Public Trust clearance/favorable suitability determination.

• Preferred: Direct experience supporting Federal clients.

• Preferred: Familiarity with FedRAMP authorization processes.

• Preferred: Experience in mortgage, fintech, or other regulated industries.

• Preferred: Knowledge of AI safety, governance, and compliance.

• Preferred: Proficient in using or teaching tools such as ChatGPT, Claude, Gemini, Notion, Airtable, Zapier, LangChain, or similar.

• Preferred: Background in startups, consulting, internal strategy, learning & development (L&D), or innovation teams.

🏝️ Benefits

• 100% remote work (US-based).

• 8-5 ET work schedule.

• Equal Opportunity Employer.