Software Quality Operations Specialist

This is a fully remote position, open to applicants in United States.

📋 Description

• Collaborate with Engineering to design, test, and launch innovative Machine Learning (ML) and Generative AI (Gen-AI) models and tools aimed at achieving significant enhancements in issue discovery & triage efficiency, as well as quality assurance.

• Utilize AI-driven insights alongside traditional triage signals to proactively uncover emerging on-road issue trends, new risk scenarios, and edge cases. Create and refine data-driven strategies for issue discovery and monitoring, augmented by ML model outputs.

• Act as the primary connection between AI/ML development and operational implementation. Establish and document new policies, guidelines, and Standard Operating Procedures (SOPs) that incorporate AI tools and insights into daily vendor operations.

• Develop and execute comprehensive quality control processes for both human-generated and AI-generated outputs. Conduct meta-quality assessments, verify the integrity of vendor output, and provide constructive feedback to enhance both human and model performance.

• Serve as the subject matter expert for our Software Quality Operations, collaborating closely with stakeholders, program leads, and vendor teams to facilitate smooth adoption and maximize the impact of AI/ML advancements within our quality processes. Be the reliable source for creating and updating technical policies, guidelines, and standard operating procedures for new scopes, platforms, and driving signals.

• Offer technical leadership and guidance to stakeholders to improve our workflows and quality. You will be pivotal in identifying and escalating issues with our tools, supplying technical requirements to engineering, and leading user testing to aid in the development and rollout of new tooling features.

• Demonstrate a proven ability to thrive in a fast-paced, high-pressure environment while exercising sound judgment.

• Possess excellent communication and interpersonal skills to effectively engage with a diverse range of individuals in a dynamic work setting.

⛳️ Requirements

• BS/BA degree or 4 years of relevant experience in AV Software Quality Operations.

• Advanced competency in supporting all stages of the machine learning development lifecycle, including data preparation and training, validation, deployment, and ongoing monitoring.

• Experience in ML testing and validation, encompassing dataset quality assurance, bias detection, edge-case scenario testing, and performance assessment using statistical metrics.

• Capability to rapidly learn and apply new concepts and use proprietary tools. Strong comprehension of driving rules and regulations.

• Must be able to work a flexible schedule, including some weekends and holidays, as required.

🏝️ Benefits

• Health, dental, vision, life, and disability insurance.

• Retirement Benefits: 401(k) with company match.

• Paid Time Off: 20 days of vacation per year, accruing at a rate of 6.15 hours per pay period for the first five years of employment.

• Sick Time: 40 hours/year (statutory, where applicable); 5 days/event (discretionary).

• Maternity Leave (Short-Term Disability + Baby Bonding): 28-30 weeks.

• Baby Bonding Leave: 18 weeks.

• Holidays: 13 paid days per year.