Senior NLP Engineer, LLM

This is a fully remote position, open to applicants in Serbia.

📋 Description

• Execute experiments with large language models (LLMs) and assess various architectures and techniques (SFT, RLHF, Adapters, etc.) to enhance the quality of conversational AI;

• Design and uphold comprehensive evaluation frameworks to measure model performance, accuracy, and user satisfaction utilizing both offline and online metrics;

• Enhance models for inference, boosting speed, efficiency, and scalability within production environments;

• Fine-tune and adjust large language models employing methods such as LoRA, QLoRA, prompt/prefix tuning, and instruction tuning;

• Work collaboratively with Data Scientists, Software Engineers, and Product Managers to incorporate AI solutions into the product pipeline;

• Engage in the enhancement of the deployment and inference stack, including evaluating serving frameworks like vLLM and SGLang.

⛳️ Requirements

• Extensive hands-on experience with LLM fine-tuning and adaptation techniques such as SFT, LoRA, QLoRA, etc.;

• Practical experience in training and enhancing NLP / LLM models, beyond just integrating third-party APIs or constructing RAG pipelines;

• Profound understanding of Machine Learning, Deep Learning, and fundamental NLP concepts;

• Familiarity with transformer-based architectures and contemporary NLP/LLM model development processes;

• Knowledge of model evaluation methodologies, offline/online metrics, and experimentation frameworks;

• Experience in inference optimization, quantization, and deployment/serving frameworks like vLLM, SGLang, or similar;

• Strong Python programming skills along with practical experience using ML frameworks such as PyTorch, Transformers, NumPy, Pandas, and Scikit-learn;

• Solid understanding of software engineering best practices and a production-oriented development mindset;

• Proficient in English at a B2+ level.

🏝️ Benefits

• REMOTE OPPORTUNITY to work full-time;

• 28 calendar days of vacation per year;

• 7 wellness days annually (time off) to manage personal matters or recuperate without needing to take sick leave;

• Bonuses of up to $5000 for successful referrals for company positions;

• 50% reimbursement for professional training, international conferences, and meetings;

• Corporate discount for English language lessons;

• Health benefits: If not eligible for corporate medical insurance, the company will reimburse up to $1,000 gross per year per employee, which can be utilized for personal health insurance purchases or medical fees for oneself and close relatives (spouse, children);

• Workplace organization: The company provides all employees with a fully equipped workspace and necessary equipment (desk, chair, wifi, etc.) in our offices or co-working spaces. In other locations, the company reimburses workplace expenses up to $1,000 gross once every three years based on paychecks. This amount can be spent on co-working rental, or furnishing a home office (desk, chair, internet, etc.) during that three-year period;

• Internal gamified gratitude system: earn bonuses from colleagues and exchange them for merchandise, team-building activities, massage vouchers, etc.