Senior Software Engineer – Akamai Inference Cloud

Posted 2 days ago

This is a fully remote position, open to applicants in Poland.

📋 Description

• Design and sustain prompt processing and tokenization pipelines to ensure efficient model execution.

• Implement request routing, scheduling, and batching strategies to enhance throughput and reduce latency for concurrent inference workloads.

• Integrate new model architectures and serving backends into the existing runtime framework.

• Produce well-tested and thoroughly documented code.

• Engage in code reviews.

• Assist in operational readiness by monitoring, debugging, and performing performance analysis of runtime components.

• Collaborate with seasoned engineers to convert user requests into optimized model inputs.


⛳️ Requirements

• Relevant experience along with a Bachelor's degree or its equivalent in Computer Science or a related discipline.

• Proficiency in Python and at least one systems programming language, such as C++, Go, or Rust.

• Understanding of natural language processing concepts, including tokenization, encoding, and text processing pipelines.

• Familiarity with AI inference, model serving, or LLM deployment.

• Knowledge of inference frameworks such as TensorRT, vLLM, TorchServe, and Triton.

• Experience in building high-throughput, low-latency data processing systems or services.

• Familiarity with Linux systems, containerized environments, and profiling or debugging tools.

• Strong desire to learn and advance within the AI inference and model serving domain.


🏝️ Benefits

• Benefits that support health, well-being, finances, and life beyond work.

• FlexBase flexible work options: at home, in an office, or a combination of both.

People also viewed

Zen Educate2 days ago

Product Engineer

US flagUnited States OnlyFull-timeFull-stack Engineer$130k – $190k/year
ApplyView job
Weekday (YC W21)2 days ago

Full Stack Builder – B2B SaaS

IN flagIndia OnlyFull-timeFull-stack Engineer₹5.5M – ₹6M/year
ApplyView job
Toast2 days ago

Staff Software Engineer

US flagUnited States OnlyFull-timeFull-stack Engineer$151k – $309k/year
ApplyView job
Milliman2 days ago

Software Engineer, R&D – IntelliScript

US flagAlaska, +10 more statesFull-timeFull-stack Engineer$80.4k – $203k/year
ApplyView job
Greenhouse Software2 days ago

Senior Software Engineer

CA flagCanada OnlyFull-timeFull-stack EngineerC$129k – C$164.5k/year
ApplyView job
AppFolio2 days ago

Staff Software Engineer – Owner, Investor

US flagCalifornia, +6 more locationsFull-timeFull-stack Engineer$167.2k – $229.9k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers