Mid/Senior AI LLM Engineer

This is a fully remote position, open to applicants in Italy, +1 more country.

📋 Description

• Fine-tune open-weight large language models (LLMs) utilizing SFT, LoRA/QLoRA, DPO, and GRPO techniques.

• Diagnose model failures and transform them into experimental tests.

• Assess whether enhancements necessitate improved data, post-training adjustments, prompting strategies, or classifiers.

• Develop training datasets and evaluations that influence future training processes.

• Enhance model performance regarding personalization, consistency, tone, multilingual capabilities, and group interactions.

• Deploy model enhancements to production environments.

• Leverage real user interactions to inform subsequent model iterations.

• Expedite the training loop for quicker, more comparable, and reproducible experimental outcomes.

• Collaborate with the LLM Tech Lead, CTO, Product, Web, and DevOps teams.

⛳️ Requirements

• Successfully post-trained open-weight LLMs for a user-facing product and deployed them to production.

• Experience in roles where AI was integral to the product or business model.

• Fine-tuning should be a primary area of expertise.

• Proficient in Python, PyTorch, and Hugging Face.

• Practical experience with GPU training and debugging.

• Capable of independently building training data and evaluations, making decisions based on evidence.

• Proven ability to advance work from notebooks to production environments.

• Regular use of AI tools in engineering tasks.

• Comfortable working with uncensored models and explicit NSFW content, including sensitive material when developing and evaluating moderation systems.

• Experience with conversational AI, roleplay products, or highly personalized consumer AI is advantageous.

• Familiarity with multilingual LLMs is a plus.

• Background in moderation, safety, or adversarial testing is beneficial.

• Experience with multimodal models is a bonus.

• Contributions to open-source LLMs or post-training projects are favorable.

• Willingness and ability to operate under a B2B contract arrangement in your country of residence.

• Legal authorization to work in your current country of residence.

🏝️ Benefits

• 4 weeks (20 working days) of paid time off (PTO) annually.

• Annual in-person meetup for team bonding.

• Monthly allowance of 100 USD for health insurance costs.

• Unlimited 1:1 sessions with psychologists and lifestyle experts via OpenUp, also available for up to three family members.

• Co-working space budget available for up to two visits per month (35 EUR / 40 USD per visit).

• Learning budget for courses, books, conferences, events, or certifications.

• Company-provided laptop.

• Budget of up to 250 USD for additional monitors.

• Budget of up to 150 USD for peripherals such as keyboards, mice, microphones, and headphones.

• Premium access to ChatGPT, Hugging Face, Claude Code, and other essential tools for the role.

• Fully remote work arrangement.

• Flexible contract structure, with a preference for B2B arrangements.