
Test & Evaluation Lead
Posted 2 days ago

Posted 2 days ago
This is a fully remote position, open to applicants in United States.
• Establish the testing strategy from automated suites for every build, utilizing simulation and system-level tests on actual platforms.
• Create and develop automated testing and evaluation capabilities that operate in simulation and hardware-in-the-loop settings.
• Construct and manage comprehensive performance scenarios, including failure situations such as unclear commands, lost connections, and unexpected mission modifications.
• Formulate and manage test KPIs based on acceptance criteria and performance metrics at the mission level.
• Monitor KPIs across builds, identify defects that pass testing thresholds, and communicate findings to leadership and clients.
• Determine entry requirements for physical testing and provide final approval for customer releases.
• Transform physical test data from the field into reproducible regression cases and evaluation contributions.
• Supervise physical test engineers, manage test planning and field activities, and develop the team.
• Occasionally travel to testing ranges and field events.
• Generate test reports and readiness documentation for leadership, clients, and program offices.
• Collaborate with systems engineering, mission engineering, simulation, and DevOps teams.
• Ensure test independence from the engineering teams being evaluated.
• A minimum of 6 years in QA, test engineering, test automation, or systems testing, including experience in leading engineers or test initiatives.
• Extensive, hands-on experience in constructing automated test suites and frameworks for complex software, ensuring they are efficient and reliable.
• Strong expertise in Python.
• Proficient in Linux.
• Practical experience with Continuous Integration (CI).
• Proven ability to define test strategies, standards, KPIs, and readiness criteria for complex systems.
• Working knowledge of testing on real hardware or platforms, and the role of field testing within a comprehensive test strategy.
• Familiarity with simulation and hardware-in-the-loop testing methodologies.
• A Bachelor’s degree in Computer Science, Engineering, or a related technical discipline, or equivalent practical experience.
• U.S. Citizenship is required.
• Current residency in the United States is mandatory.
• Permanent residency or visa sponsorship is not an option due to regulatory constraints.
• Experience in developing evaluations for ML models in production, including designing test sets, selecting metrics, and identifying regressions that standard accuracy metrics may overlook (preferred).
• Experience testing systems with machine learning components (preferred).
• Background in robotics, unmanned systems, or autonomy testing (preferred).
• Experience in defense test and evaluation, including test plans, TEMPs, and government deliverable reporting (preferred).
• Experience establishing a test function in a startup or small company (preferred).
• Significant equity stake.
• 100% remote work opportunity for residents across the United States.
• Comprehensive medical, dental, and vision insurance plans.
• 401(k) plan with a 6% company match.
• Generous Discretionary Time Off (DTO) policy.
• Elite technology package.
• Low-stress interview process with no trick questions or brain teasers.
Smart Care
Amgen
Amgen
Hamilton Medical
Get handpicked remote jobs straight to your inbox weekly.