Senior Agentic AI Engineer, Simulation and Evaluation

This is a fully remote position, open to applicants in California.

📋 Description

• Design and implement agentic systems that facilitate automation in simulation, evaluation, performance analysis, and reporting.

• Create tools that allow for the configuration of experiments, execution of evaluations, result analysis, regression identification, and follow-up work recommendations.

• Examine the inference characteristics of large language models (LLMs), reasoning models, coding agents, multimodal models, and agentic harnesses.

• Develop and validate performance models tailored for GPU, LPU, and heterogeneous GPU–LPU systems.

• Collaborate effectively with teams involved in inference, hardware, runtime, compiler, evaluation, and product development.

• Streamline LPU workflows, which include benchmarking, workload characterization, capacity planning, and release qualification.

⛳️ Requirements

• Proven experience in building AI agents or AI-enhanced engineering systems.

• Understanding of contemporary model architectures and AI inference workloads.

• Experience in evaluating AI models or agents and conducting performance analyses.

• Background in simulation, profiling, benchmarking, or performance modeling.

• Proficient in Python with a history of developing dependable engineering tools.

• Master’s degree in Computer Science, Engineering, or a closely related field, or comparable experience.

• Over 5 years of pertinent software development experience.

• At least 2 years of experience in developing AI agents or AI-supported engineering systems.

• Familiarity with coding agents like Codex, Claude Code, or equivalent tools for automating technical workflows.

• Knowledge of GPU or accelerator architecture, distributed inference, or high-performance computing.

• A meticulous analytical mindset towards experimentation, data gathering, and validation.

🏝️ Benefits

• Equity

• Benefits

• Inclusive work environment