Senior Machine Learning Software Engineer

This is a fully remote position, open to applicants in Massachusetts.

📋 Description

• Create and uphold model validation and security scanning pipelines to evaluate models for quality, accuracy, and vulnerabilities prior to deployment.

• Apply quantization, pruning, and various optimization methods to diminish model size and enhance inference latency across a range of hardware configurations.

• Develop guardrail and content safety systems that ensure compliance with policies while reducing risks associated with jailbreaking and prompt injection.

• Design infrastructure for model routing and prompt management to facilitate intelligent request handling among different model variants.

• Contribute to model evaluation frameworks that assess accuracy, performance, and safety metrics throughout the model lifecycle.

• Construct and manage systems responsible for model validation, quantization, and safety within the Akamai Inference Cloud.

⛳️ Requirements

• A minimum of 5 years of relevant experience.

• Bachelor's or Master's degree in Computer Science, Machine Learning, or a related discipline.

• Hands-on experience with PyTorch, TensorFlow, or JAX, including aspects of model training, fine-tuning, and inference optimization.

• Expertise in GPTQ, AWQ, and GGUF model quantization techniques.

• Knowledge of the effects of model compression on accuracy and latency.

• Experience working with large language models, transformer architectures, and multi-modal AI systems.

• Familiarity with model safety and responsible AI practices, such as content filtering, red-teaming, or evaluating adversarial robustness.

• Proficient in Python and experienced in developing production data or ML pipelines.

• Experience with containerized deployments, CI/CD practices, and cloud infrastructure is preferred but not mandatory.

🏝️ Benefits

• Flexible work options allowing remote, in-office, or a combination of both.

• Comprehensive healthcare coverage.

• 401K savings plan.

• Company holidays.

• Paid time off (PTO) for vacation.

• Sick leave.

• Parental leave.

• Employee assistance program.

• Support for mental wellness.

• Financial wellness support.

• Annual bonuses or incentives.

• Equity awards.

• Employee Stock Purchase Plan (ESPP).

• Opportunities for personal and professional growth, allowing you to thrive and achieve remarkable accomplishments.