Senior Software Engineer Lead

This is a fully remote position, open to applicants in Massachusetts.

📋 Description

• Oversee the design and execution of essential platform elements for Akamai Inference Cloud.

• Lead technical choices for AI inference tasks, including the selection of tools, frameworks, and methodologies.

• Provide mentorship and support to engineers through code evaluations, design discussions, and resolution of technical challenges.

• Develop and enhance containerized AI workloads with optimizations tailored to specific hardware.

• Scale integration of inference frameworks.

• Collaborate with various teams to establish technical requirements and contribute to platform standards.

• Ensure operational excellence and the delivery of high-quality, scalable solutions.

• Design and enhance globally distributed systems that provide OpenAI-compatible endpoints and manage inference workloads across multiple regions.

⛳️ Requirements

• A minimum of 8 years of pertinent experience.

• Bachelor's degree or an equivalent qualification.

• Expertise in distributed systems, cloud services, and platform engineering.

• Practical experience with AI inference, model serving, or deployment of large language models (LLMs).

• Familiarity with TensorRT, vLLM, TorchServe, and Triton.

• Proficient in Kubernetes, Docker, and cloud-native architectures.

• Experience in constructing scalable, high-performance systems.

• Knowledge of contemporary DevOps practices, CI/CD pipelines, and infrastructure-as-code.

• Demonstrated technical leadership through mentoring, advocating for code quality, and developing technical solutions for intricate issues.

• Understanding of REST/gRPC API design and development.

• Acquainted with GPU infrastructure and hardware acceleration.

• Awareness of observability, monitoring, and debugging in distributed systems.

🏝️ Benefits

• Annual bonus or incentives.

• Equity awards.

• Employee Stock Purchase Plan (ESPP).

• Healthcare coverage.

• 401K savings plan.

• Company holidays.

• Paid time off (PTO) for vacation.

• Sick leave.

• Parental leave.

• Employee assistance program.

• Support for mental and financial wellness.

• Flexible work arrangements: at home, in an office, or a blend of both.