Software Quality Operations Specialist

This is a fully remote position, open to applicants in United States.

📋 Description

• Collaborate with Engineering to conceptualize, test, and implement Machine Learning and Generative AI models and tools.

• Leverage AI-driven insights along with traditional triage indicators to detect emerging trends in on-road issues, risk scenarios, and edge cases.

• Create and enhance data-informed strategies for issue discovery and monitoring.

• Establish and document policies, guidelines, and Standard Operating Procedures that incorporate AI tools into vendor workflows.

• Design and execute quality control measures for outputs generated by both humans and AI.

• Conduct meta-quality assessments and verify the work of vendors.

• Offer constructive feedback to enhance both human and model performance.

• Act as the subject matter expert in Software Quality Operations for stakeholders, program leads, and vendor teams.

• Develop and revise technical policies, guidelines, and SOPs for new scopes, platforms, and driving signals.

• Provide technical leadership and advice to enhance workflows and overall quality.

• Identify and escalate tooling challenges, relay technical requirements to Engineering, and facilitate user testing for new tooling features.

⛳️ Requirements

• Bachelor's degree or 4 years of applicable work experience in AV Software Quality Operations.

• Advanced proficiency in supporting all stages of the machine learning development lifecycle, from data preparation and training to validation, deployment, and ongoing monitoring.

• Experience in ML testing and validation, including dataset quality assurance, bias detection, edge-case scenario testing, and performance assessment using statistical metrics.

• Capability to swiftly learn and apply new concepts and use proprietary tools.

• Strong knowledge of driving laws and regulations.

• Willingness to be on-call occasionally during evenings, weekends, and holidays.

• Flexibility to participate in meetings outside of standard hours for collaboration with the global team.

• Ability to thrive in a fast-paced, high-pressure environment while exercising sound judgment.

• Exceptional communication and interpersonal abilities.

• Preferred: experience collaborating with offshore teams or various local operations hubs.

• Preferred: foundational knowledge of SQL querying.

• Preferred: proficiency in LLM/transformer models and/or ML applications for robotics.

🏝️ Benefits

• Coverage for health, dental, vision, life, and disability insurance.

• Retirement Benefits: 401(k) plan with company matching.

• Paid Time Off: 20 vacation days annually, accruing at a rate of 6.15 hours per pay period for the first five years of employment.

• Sick Leave: 40 hours/year (statutory, where applicable); 5 days/event (discretionary).

• Maternity Leave (Short-Term Disability + Baby Bonding): 28-30 weeks.

• Baby Bonding Leave: 18 weeks.

• 13 paid holidays each year.

• Discretionary annual bonus program.

• Equity incentive plan.

• Comprehensive company benefits program.