QA Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Take ownership of the system test plan that encompasses functional, integration, performance, and load testing.

• Convert product acceptance criteria into actionable tests.

• Assess acceptance criteria and pinpoint any ambiguous or unverifiable requirements prior to development.

• Hold engineering, platform, and partner teams accountable for acceptance criteria and the evidence required for release.

• Collaborate with engineering while independently reporting test outcomes.

• Organize and facilitate customer user acceptance testing, ensuring findings are tracked to resolution.

• Develop and sustain automated test suites that are integrated into CI/CD processes as release gates.

• Set and report on automated coverage standards.

• Create performance and load tests tailored for anticipated user loads.

• Ensure regression coverage is maintained across releases.

• Collaborate with subject-matter experts to build labeled evaluation sets.

• Design and conduct sampled audits of automated decisions.

• Measure system misses, correct results, and user overrides.

• Document measurement methods, data, and release evidence comprehensively.

• Manage version inventories across builds, models, configurations, and thresholds.

• Generate test reports, evaluation records, and rollback criteria for releases.

• Ensure test environments closely resemble production.

• Enforce release gates to prevent any release from shipping without the necessary evidence.

• Report to the Product Lead while engaging in daily collaboration with engineering and platform teams.

⛳️ Requirements

• A minimum of 5 years in software quality engineering, test automation, or software engineering with significant dedicated test ownership.

• A well-defined perspective on testing methodologies and the discernment to recognize which practices are essential.

• Proficient coding skills in a language and framework applicable to test automation, such as Python with pytest, or JavaScript or TypeScript with Playwright, Cypress, or Selenium.

• Capability to read and understand the application code under test.

• Regular use of AI-assisted development, coupled with informed judgment regarding verification.

• Proven experience in creating automated test suites and integrating them into CI/CD as release gates.

• Background in managing a test plan through the review and acceptance phases.

• Experience in testing based on requirements as opposed to implementation, including direct collaboration with product owners or end users.

• Familiarity with performance and load testing.

• Working knowledge of statistical concepts, including sampling design and measurement confidence.

• Experience in measuring system misses, not just correct outputs.

• Preparedness to independently report unfavorable outcomes.

• Ability to gate work conducted by individuals who do not report directly to you.

• Proficient in producing clear, audit-ready written documentation.

• Willingness to explain and defend release decisions.

• U.S. Citizenship is required.

• Active U.S. Secret clearance is necessary.

• A favorable investigation and CAC eligibility from the outset.

• Availability to travel up to 25% to customer sites, DEFCON AI HQ, and vendor locations.

• Preferred qualifications include active Top Secret clearance, experience in government DevSecOps/RMF/ATO environments, contract and API testing, test data management, test infrastructure, AI-assisted testing, JMeter/k6/Locust, machine-learning output evaluation, model cards/NIST AI RMF, and Section 508 and WCAG verification.

🏝️ Benefits

• Competitive salary, bonus, and equity package.

• Comprehensive health insurance, including medical, dental, and vision, fully covered by the employer for you and your family.

• Unlimited PTO, subject to manager’s approval.

• Flexible work environment that allows you to manage your workday.

• 14 weeks of fully-paid parental leave.

• Career advancement opportunities with potential for rapid growth based on strong performance as the firm expands.

• Access to professional development and ongoing learning opportunities.

• Optional 401K, FSA, and equity incentives available.

• Mental health benefits accessible through Tara Mind.

• Cost-effective GLP-1 solutions available through Crux.