GPU Performance and Benchmarking Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and implement performance benchmarks for AI training and inference tasks.

• Profile and analyze GPU workloads to pinpoint performance limitations and areas for optimization.

• Systematically adjust workload parameters (such as batch size, precision, parallelism, memory, etc.) to enhance throughput.

• Establish and uphold performance baselines and success metrics across various GPU platforms.

• Create benchmarking tools, scripts, and automation to ensure consistent performance validation.

• Analyze benchmark outcomes and provide actionable insights for engineering teams.

• Validate the performance of new GPU hardware platforms prior to production deployment.

• Collaborate with GPU Engineers and Fabric Engineers to relate performance with system-level health.

• Monitor and assess emerging GPU architectures and software releases for their performance implications.

• Document benchmarking methodologies, tuning guides, and performance best practices.

⛳️ Requirements

• 3–7 years of experience in GPU performance engineering, benchmarking, or High-Performance Computing (HPC).

• Practical experience with GPU profiling and benchmarking tools (such as NVIDIA Nsight, DCGM, nccl-tests, MLPerf, GPU-Burn).

• Strong grasp of AI/ML workload performance characteristics (including training vs. inference, batch sizing, and precision modes).

• Experience in tuning performance parameters across GPU, CUDA, and framework layers.

• Familiarity with leading GPU platforms (NVIDIA, AMD) and their associated performance tools.

• Proficiency in Python for scripting benchmarks and conducting data analysis.

• Basic knowledge of Linux systems and server hardware.

• Understanding of high-speed networking concepts (InfiniBand, RoCE, NCCL) and their effects on distributed performance.

• Strong analytical abilities to convert data into clear recommendations.

• Excellent written communication skills for creating performance reports and documentation.

🏝️ Benefits

• 100% company-covered insurance premiums for employee medical, dental, and vision plans.

• 401(k) plan that matches 100% up to 4%, with immediate vesting.

• Professional Development Reimbursement of $2,500 each year.

• 11 Holidays + Paid Time Off Accrual + Rollover Plan.

• Commitment matters to Vultr! Increased PTO at 3-year and 10-year anniversaries + 1 month paid sabbatical every 5 years + Anniversary Bonus each year.

• $500 stipend for remote office setup in the first year + $400 each following year.

• Internet reimbursement up to $75 per month.

• Gym membership reimbursement up to $50 per month.

• Company-paid Wellable subscription.