Principal AI Engineer – AI Applied Scientist

This is a fully remote position, open to applicants in United States.

📋 Description

• Create and implement solutions powered by LLM for automating decisions, investigating fraud, and streamlining processes within FICO’s platform.

• Formulate prompting strategies and Retrieval-Augmented Generation (RAG) frameworks for critical applications.

• Utilize fine-tuning, in-context learning methods, and tailored evaluation frameworks to enhance AI model efficiency.

• Develop systems for model evaluation and governance to ensure compliance and reliability.

• Design and carry out backtesting methods to assess model predictions and overall performance.

• Set up A/B testing frameworks to analyze AI interventions.

• Oversee model performance and identify drift.

• Investigate and incorporate the most recent AI advancements.

• Assess new models, architectures, and training methodologies.

• Create custom RAG implementations to improve information retrieval.

• Produce high-quality, scalable, dependable, and secure machine-learning systems.

• Architect scalable solutions supporting FICO’s analytics and decision-making tools.

• Implement monitoring strategies and system reliability assessments.

⛳️ Requirements

• Significant industry experience in software, machine learning, or data engineering.

• Proven track record of managing intricate, large-scale projects and influencing strategic technical choices.

• Comprehensive knowledge and experience in fine-tuning, model adaptation, and customization.

• Proficiency in machine learning evaluation and testing methodologies, including custom evaluation frameworks.

• Extensive experience with Retrieval-Augmented Generation (RAG) frameworks.

• Familiarity with vector databases.

• Strong practical coding skills in Python, Go, Java, or similar programming languages.

• Experience with PyTorch, JAX, or comparable deep learning frameworks.

• Understanding of backtesting methodologies.

• Experience with A/B testing frameworks.

• Expertise in model monitoring, drift detection, and governance.

• Preferred proven expertise in modern Large Language Models (LLMs) and their applications.

• Strong abilities in prompt engineering and chain-of-thought prompting techniques.

• Familiarity with compliance and regulatory technologies, especially in AI-driven decision-making environments.

• Solid software engineering fundamentals, production-quality coding, and scalable architecture design.

• Capacity to mentor teams and collaborate across different departments.

• Experience in fast-paced, high-growth, high-stakes settings.

• Publications, patents, or open-source contributions showcasing thought leadership and technical proficiency in AI and machine learning.

• Bachelor’s/Master’s/PhD degree in computer science or a related field with a focus on Machine Learning.

🏝️ Benefits

• An inclusive culture that embodies our core values.

• Opportunities for professional development and meaningful learning experiences.

• Competitive salary, benefits, and reward programs.

• Work/life balance.

• Employee resource groups.

• Social events.

• Employment and advancement opportunities without regard to protected characteristics.