Senior AI Engineer

This is a fully remote position, open to applicants in Spain.

📋 Description

• Spearhead the design and implementation of applications powered by LLM, including chatbots, copilots, agents, and internal tools.

• Take ownership of the LLM evaluation (evals) strategy, which involves creating gold-standard datasets and benchmarks, developing automated eval pipelines and scoring systems, and establishing metrics for factuality, grounding, robustness, and user impact.

• Identify and resolve intricate failure modes such as hallucinations, retrieval challenges, and agent malfunctions.

• Enhance systems for latency, cost-effectiveness, scalability, and reliability in production environments.

• Provide mentorship to junior engineers and promote best practices in the development and evaluation of LLM.

• Work collaboratively across functions with product, data, and leadership teams to influence AI strategy.

• Establish benchmarks for responsible AI, focusing on safety, bias mitigation, and observability.

⛳️ Requirements

• A minimum of 5 years of experience in software engineering, machine learning, and applied AI, with a proven ability to see projects through to completion.

• Strong foundational skills in software engineering (including testing, modular design, and dependency injection) using Python.

• Demonstrated experience in taking AI and LLM-driven features from conception to deployment and ensuring long-term production maintenance.

• Familiarity with implementing automated testing strategies for non-deterministic systems, along with strong debugging and analytical capabilities for managing ambiguous model behavior.

• Comprehensive knowledge of prompt engineering and prompt lifecycle management, RAG architectures, retrieval evaluation, and recognizing LLM limitations and failure patterns.

• Extensive experience utilizing Data Analytics techniques (SQL, analysis, and visualizations) to guide Product decisions and delivery.

• A strong product-oriented mindset to thoroughly understand our product and customer needs, facilitating the creation of appropriate solutions.

• Exceptional tech leadership and mentorship abilities, with the capacity to independently lead projects to successful completion.

• Ability to communicate effectively regarding trade-offs, risks, and system performance to various stakeholders.

🏝️ Benefits

• Enjoy the flexibility of working from home whenever it suits you.

• Receive 25 working days of paid vacation alongside Jornada Intensiva in August.

• Access premium Cigna health insurance, which includes travel insurance, a dental plan, psychological support, and coverage for pre-existing conditions.

• Save on meals with a monthly allowance of 150€, complemented by a Flexible Remuneration plan offering up to 70€. Additionally, benefit from a 50% discount on Ametller’s prepared dishes to enhance your mealtime experience!

• Flexible Remuneration options available for your transportation needs.

• Improve your workspace with a home-office setup allowance, ensuring you have all necessary resources for a productive and comfortable work environment.

• Take advantage of free Spanish language classes.

• Increase your earning potential through our referral program that provides paid compensation.

• Energize your day with a daily breakfast buffet at the office and participate in our monthly events, including football tournaments, wine tastings, hikes, kayaking, and more!