
Senior Principal AI Engineer
Posted 1 day ago

Posted 1 day ago
This is a fully remote position, open to applicants in Ireland.
• Establish the technical vision, architecture, and multi-year roadmap for LLM and agentic systems within Detection and Response, as well as Exposure and Remediation.
• Develop a comprehensive model strategy for the company, incorporating the use of frontier or open-source models, fine-tuning, distillation, post-training, and investment in new capabilities.
• Spearhead intricate, high-stakes technical initiatives across various teams, focusing on the fine-tuning, distillation, and post-training of open-source LLMs utilizing security data.
• Set company-wide standards for context engineering, inference optimization, and evaluation, with evaluations acting as the release gate for AI systems.
• Oversee the optimization of LLM inference at scale, ensuring a balance between quality, latency, and cost.
• Conduct design reviews and address complex technical trade-offs.
• Prototype and develop essential model, training, and inference code.
• Mentor and cultivate the skills of Principal, Staff, and Senior engineers.
• Represent Rapid7’s AI engineering efforts to executives, customers, and the external community.
• Shape product, platform, and business strategy.
• 14+ years of experience in software or ML engineering, including at least 2 years focused on building production LLM or agentic AI systems.
• A PhD in Computer Science, Machine Learning, AI, or a related field is preferred, or an equivalent level of expertise demonstrated through industry experience and technical contributions.
• Proven history of developing scalable, production-grade AI systems and shared platforms utilized across multiple products.
• Cutting-edge knowledge in LLMs, including transformer architecture, attention mechanisms, tokenization, and positional encodings.
• Advanced proficiency in PyTorch, including custom model code, mixed precision, and distributed training (e.g., FSDP, DeepSpeed).
• Practical experience in fine-tuning and post-training of open-weight LLMs, utilizing both full and parameter-efficient methods (LoRA, QLoRA), distillation, and preference or RL-based techniques (e.g., DPO, GRPO).
• Extensive experience with context engineering, retrieval, memory, and context management for long-term agent workflows.
• Familiarity with defining evaluation strategies and benchmarks for LLM and agent systems.
• Profound understanding of inference optimization, including prefill and decode processes, KV-cache management, continuous batching, speculative decoding, and quantization.
• Experience serving models at scale using vLLM, SGLang, or TensorRT-LLM, ideally on AWS, including GPU kernel work (CUDA or Triton).
• Strong foundation in predictive AI, classical ML, distributed systems, and Python.
• Capacity to make efficient and transparent decisions among predictive AI, classical ML, and LLM approaches based on accuracy, latency, and cost considerations.
• Accountability for organization-wide technical outcomes, proactively mitigating systemic risks and eliminating barriers to delivery.
• Influential communication skills to articulate complex architectural trade-offs, foster consensus, and impact technical and product decisions.
• Ability to create alignment across Engineering, Product, and other departments.
• Skill in anticipating evolving customer needs and shaping AI architecture and technical strategy accordingly.
• Capability to thrive amidst ambiguity at the forefront of AI innovation.
• Recognized as an expert in AI, evidenced by publications, patents, open-source contributions, or industry engagement.
• Commitment to the core values of Rapid7.
• Variable/incentive compensation, equity, and benefits (where applicable/eligible).
• Fair and equitable compensation practices.
• Collaborative work environment that encourages new ideas.
Extend
OhioHealth
Capital One
Software Mind
Get handpicked remote jobs straight to your inbox weekly.