Test & Evaluation Lead

atPrimordial LabsRemoteUS flagUnited StatesFull-timeUncategorizedSenior$170k – $210k/year

Posted 2 days ago

This is a fully remote position, open to applicants in United States.

📋 Description

• Establish the testing strategy from automated suites for every build, utilizing simulation and system-level tests on actual platforms.

• Create and develop automated testing and evaluation capabilities that operate in simulation and hardware-in-the-loop settings.

• Construct and manage comprehensive performance scenarios, including failure situations such as unclear commands, lost connections, and unexpected mission modifications.

• Formulate and manage test KPIs based on acceptance criteria and performance metrics at the mission level.

• Monitor KPIs across builds, identify defects that pass testing thresholds, and communicate findings to leadership and clients.

• Determine entry requirements for physical testing and provide final approval for customer releases.

• Transform physical test data from the field into reproducible regression cases and evaluation contributions.

• Supervise physical test engineers, manage test planning and field activities, and develop the team.

• Occasionally travel to testing ranges and field events.

• Generate test reports and readiness documentation for leadership, clients, and program offices.

• Collaborate with systems engineering, mission engineering, simulation, and DevOps teams.

• Ensure test independence from the engineering teams being evaluated.


⛳️ Requirements

• A minimum of 6 years in QA, test engineering, test automation, or systems testing, including experience in leading engineers or test initiatives.

• Extensive, hands-on experience in constructing automated test suites and frameworks for complex software, ensuring they are efficient and reliable.

• Strong expertise in Python.

• Proficient in Linux.

• Practical experience with Continuous Integration (CI).

• Proven ability to define test strategies, standards, KPIs, and readiness criteria for complex systems.

• Working knowledge of testing on real hardware or platforms, and the role of field testing within a comprehensive test strategy.

• Familiarity with simulation and hardware-in-the-loop testing methodologies.

• A Bachelor’s degree in Computer Science, Engineering, or a related technical discipline, or equivalent practical experience.

• U.S. Citizenship is required.

• Current residency in the United States is mandatory.

• Permanent residency or visa sponsorship is not an option due to regulatory constraints.

• Experience in developing evaluations for ML models in production, including designing test sets, selecting metrics, and identifying regressions that standard accuracy metrics may overlook (preferred).

• Experience testing systems with machine learning components (preferred).

• Background in robotics, unmanned systems, or autonomy testing (preferred).

• Experience in defense test and evaluation, including test plans, TEMPs, and government deliverable reporting (preferred).

• Experience establishing a test function in a startup or small company (preferred).


🏝️ Benefits

• Significant equity stake.

• 100% remote work opportunity for residents across the United States.

• Comprehensive medical, dental, and vision insurance plans.

• 401(k) plan with a 6% company match.

• Generous Discretionary Time Off (DTO) policy.

• Elite technology package.

• Low-stress interview process with no trick questions or brain teasers.

People also viewed

Smart Care1 day ago

Commercial Kitchen Service Technician

US flagUnited States OnlyFull-timeUncategorized
ApplyView job
Amgen1 day ago

Medical Value & Access Liaison – National & Strategic Accounts

US flagAlabama, +46 more locationsFull-timeUncategorized$157.8k – $213.5k/year
ApplyView job
Amgen1 day ago

Medical Value & Access Liaison, National Accounts

US flagAlabama, +44 more locationsFull-timeUncategorized$157.8k – $213.5k/year
ApplyView job
Hamilton Medical1 day ago

Clinical Applications Specialist

GE flagGeorgia OnlyFull-timeUncategorized
ApplyView job
MSD1 day ago

Vaccine Customer Representative

US flagPennsylvania, +1 more locationFull-timeUncategorized$79.2k – $124.7k/year
ApplyView job
Amgen1 day ago

Medical Value & Access Liaison – National & Strategic Accounts

US flagAlabama, +46 more locationsFull-timeUncategorized$157.8k – $213.5k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers