Senior Software Engineer, Autonomy Evaluation

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and implement metrics and analyses to evaluate the performance of autonomous driving software throughout the autonomy stack.

• Collaborate with developers of autonomy and systems engineers.

• Create and execute algorithms that summarize, aggregate, and cluster metrics derived from simulations and real-world autonomy operations.

• Suggest and develop statistical and machine learning methods to measure performance and identify behavior patterns in systems and subsystems.

• Analyze machine learning components within the autonomy stack, covering perception, prediction, and planning models.

• Construct and maintain dashboards for autonomy evaluation and interactive reports aimed at trend analysis, drift detection, and scenario coverage.

• Utilize vision-language models and large language models to evaluate autonomy performance, pinpoint critical scenarios, and prioritize validation tasks.

• Incorporate human-in-the-loop reviews as necessary.

• Uphold high technical standards through system design, code reviews, testing, observability, and best practices in software engineering.

• Engage with cross-organizational partners to clarify requirements, address handoff challenges, and disseminate best practices related to evaluation, metrics, and experiment design.

⛳️ Requirements

• Over 5 years of practical experience with robotics or autonomous systems software, data analysis, machine learning evaluation, or autonomy analytics.

• More than 3 years of experience evaluating dynamic systems using numerical and/or machine learning techniques, including time-series data, state derivatives, dynamics, and interconnected subsystems.

• Strong expertise in developing Python in production team settings, encompassing testing, performance, and code review.

• Proficient in using Pandas, NumPy, SciPy, and visualization libraries for large-scale data analysis and reporting.

• Comfortable working with C++ codebases, including reading, debugging, and instrumenting core algorithms.

• Proven technical leadership abilities, including guiding architectural decisions, influencing designs across teams, and managing complex features or services from inception to completion.

• Bachelor’s, Master’s, or PhD in Computer Science, Robotics, Mechanical or Aerospace Engineering, Machine Learning, Data Science, or a related discipline, or equivalent practical experience.

• Experience in the fields of autonomous driving or field robotics.

• Background in evaluating robotics or autonomous vehicle systems using sensor data such as cameras, lidar, or radar.

• Familiarity with statistical modeling, experimental design, and hypothesis testing.

• Proficient in both C++ and SQL.

• Experience with ROS or similar robotics/IPC frameworks, log pipelines, and large-scale experiment databases or evaluation platforms.

• Knowledge of computational geometry, linear algebra, PyTorch, and machine learning techniques applied to perception, prediction, planning, or control.

• Experience in modeling agent interactions and contributing to release gating and safety decisions for autonomous systems.

• Experience utilizing AI-assisted development and analytics tools.

🏝️ Benefits

• Information about benefits is available through GM Total Rewards resources.

• General Motors provides reasonable accommodations for individuals with disabilities.

• An inclusive and non-discriminatory workplace.

• Information regarding role-related assessments and/or pre-employment screenings is provided.