Information Extraction Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Take ownership of the system test plan encompassing functional, integration, performance, and load testing.

• Convert product acceptance criteria into actionable tests.

• Evaluate acceptance criteria and pinpoint ambiguous or unverifiable requirements.

• Ensure accountability of engineering, platform, and partner teams to acceptance criteria and release evidence.

• Collaborate daily with engineering while preserving testing independence.

• Organize and manage customer user acceptance testing and monitor findings until resolution.

• Develop and maintain automated test suites that are integrated into CI/CD release gates.

• Set and report on automated coverage standards.

• Create performance and load tests to validate expected user load.

• Maintain regression coverage throughout releases.

• Assemble labeled evaluation sets in collaboration with subject-matter experts.

• Design and conduct sampled audits of automated decisions.

• Measure system misses, accuracy of outputs, and trends in user overrides.

• Document measurement calculations, data sources, and release evidence.

• Generate evidence independently from model builders.

• Keep an inventory of versions across builds, models, configurations, and thresholds.

• Produce test reports, evaluation records, and rollback criteria for releases.

• Ensure test environments sufficiently replicate production settings.

• Uphold the release gate, ensuring no release occurs without the required evidence.

⛳️ Requirements

• Over 5 years of experience in software quality engineering, test automation, or software engineering with a significant focus on test ownership.

• A clear perspective on effective testing strategies and sound judgment on which practices to enforce.

• Proficient coding skills in a test-automation language/framework, such as Python with pytest or JavaScript/TypeScript with Playwright, Cypress, or Selenium.

• Ability to interpret and analyze application code under test.

• Regular use of AI-assisted development, with discernment regarding verification.

• Proven experience in building automated test suites and their integration into CI/CD as release gates.

• Background in managing a test plan through review and acceptance processes.

• Experience in testing based on requirements rather than implementations, including collaboration with product owners or end users.

• Familiarity with performance and load testing.

• Working knowledge of statistics, including sampling design and measurement confidence.

• Experience in assessing what a system omits.

• Willingness to report undesirable results independently.

• Ability to gate work managed by individuals outside the reporting line.

• Clear, audit-ready written documentation skills.

• Willingness to uphold and clarify release gates.

• US citizenship is mandatory.

• An active US Secret clearance is required; favorable investigation and CAC eligibility are necessary from the outset.

• Elevated security requirements apply to certain aspects of the work.

• Willingness to travel up to 25%.

• Preferred qualifications: active Top Secret clearance; experience with government DevSecOps/RMF/ATO; contract/API testing; test data management; test infrastructure; AI-assisted testing; JMeter, k6, or Locust; ML/model-output evaluation; model cards/NIST AI RMF; Section 508 and WCAG verification.

🏝️ Benefits

• Fully remote, results-oriented work environment.

• Competitive salary, bonus, and equity package.

• Comprehensive health insurance, including medical, dental, and vision, fully covered by the employer for you and your family.

• Unlimited PTO, subject to manager/management approval.

• Flexible work environment that allows you to manage your workday effectively.

• 14 weeks of fully paid parental leave at regular pay.

• Career advancement opportunities with potential for rapid growth.

• Access to professional development and ongoing learning.

• Optional 401(k), FSA, and equity incentives.

• Mental health support through Tara Mind.

• Cost-effective GLP-1 solutions available through Crux.