CUDA Engineer

This is a fully remote position, open to applicants in Greece.

📋 Description

• Investigate and enhance the performance of LLM inference on contemporary GPUs.

• Collaborate with inference and serving frameworks such as vLLM, SGLang, TensorRT-LLM, or comparable systems.

• Analyze GPU execution, memory access patterns, kernel performance, and inference constraints.

• Develop, optimize, debug, or reverse-engineer CUDA kernels and low-level GPU functionalities.

• Explore optimization strategies for matrix multiplication, attention mechanisms, and neural network layers.

• Benchmark performance and pinpoint opportunities for improvements in latency, throughput, and GPU utilization.

• Tackle technically demanding challenges that require analytical thinking and practical experimentation.

• Engage with international products alongside leading companies through MWDN, a global IT outstaffing firm.

⛳️ Requirements

• Extensive hands-on experience with CUDA and GPU programming.

• Profound understanding of GPU architecture, memory hierarchy, parallel execution, and performance optimization.

• Experience with LLM inference, AI systems, GPU kernels, or high-performance computing.

• Familiarity with one or more of vLLM, SGLang, TensorRT-LLM, Triton, or FlashAttention.

• Experience in debugging intricate performance issues and examining low-level system behavior.

• Strong problem-solving capabilities.

• Proficient in conveying complex technical ideas in English.

• PhD or research experience in Computer Science, Machine Learning, Computer Architecture, or a related field (desirable).

• Publications, research projects, or significant contributions to open-source GPU/LLM infrastructure (desirable).

• Familiarity with PyTorch internals, distributed inference, quantization, KV cache optimization, or custom GPU kernels (desirable).

• Contributions to vLLM, SGLang, Triton, FlashAttention, or related repositories (desirable).

🏝️ Benefits

• Security: carefully vetted clients to minimize risks and ensure reliability and timely payments.

• Career support and assistance in discovering new opportunities.

• Legal assistance regarding independent contractor or sole proprietorship status, taxes, and associated processes.

• English language courses.

• Opportunities for professional growth.

• Team-building events.

• People-first management with minimal bureaucracy.

• A friendly company culture.

• Flexible working hours.

• 29 days of paid time off (18 working days per year plus all national holidays).

• 10 paid recovery days.

• Comprehensive financial and legal support for independent contractors.

• Free English classes with native speakers or Ukrainian teachers.

• Dedicated HR support.