Senior ML Engineer, LLM

This is a fully remote position, open to applicants in Poland.

📋 Description

• Contribute to Sophea AI through LLM pre-training, training from the ground up, fine-tuning, evaluation, and ongoing model enhancement.

• Develop production-ready ML pipelines for inference, deployment, servicing, monitoring, and management of the model lifecycle.

• Enhance model performance in production settings, focusing on aspects such as latency, throughput, cost efficiency, quantization, and GPU workload utilization.

• Collaborate with datasets, conduct experiments, utilize benchmarks, and apply evaluation techniques to elevate the quality of language models and their domain-specific performance.

⛳️ Requirements

• Extensive hands-on experience with LLMs, encompassing pre-training, training from scratch, fine-tuning, evaluation, and performance optimization.

• Solid ML engineering foundation, including proficiency in Python, PyTorch, Docker, and best practices in production ML.

• Familiarity with model serving, optimization of inference, quantization, GPU workloads, and tools such as vLLM, SGLang, NVIDIA Triton, TensorRT, TGI, or equivalent frameworks.

• Capability to construct production-grade ML systems rather than mere research prototypes, basic scripts, RAG applications, or superficial AI integrations.

• Proficiency in the Polish language at a native level.

🏝️ Benefits

• Compensation: competitive salary package consistent with industry talent benchmarks.

• Impact: engage in a hands-on role with Sophea AI, one of the most ambitious AI products focused on the Greek market.

• Work format: option for remote work, with relocation assistance available for candidates willing to work from our Athens office.

• AI-native environment: face real challenges in LLMs, training, fine-tuning, optimization of inference, GPU workloads, and production-level AI systems.

• NVIDIA ecosystem: access to relevant conferences, certifications, internal knowledge sharing, and cutting-edge AI infrastructure through Kiefer’s strategic partnerships.

• Culture: engineering-centric, high autonomy, minimal bureaucracy, and opportunities to develop impactful AI products.