Senior Principal AI Engineer

Posted 1 day ago

This is a fully remote position, open to applicants in Ireland.

📋 Description

• Establish the technical vision, architecture, and multi-year roadmap for LLM and agentic systems within Detection and Response, as well as Exposure and Remediation.

• Develop a comprehensive model strategy for the company, incorporating the use of frontier or open-source models, fine-tuning, distillation, post-training, and investment in new capabilities.

• Spearhead intricate, high-stakes technical initiatives across various teams, focusing on the fine-tuning, distillation, and post-training of open-source LLMs utilizing security data.

• Set company-wide standards for context engineering, inference optimization, and evaluation, with evaluations acting as the release gate for AI systems.

• Oversee the optimization of LLM inference at scale, ensuring a balance between quality, latency, and cost.

• Conduct design reviews and address complex technical trade-offs.

• Prototype and develop essential model, training, and inference code.

• Mentor and cultivate the skills of Principal, Staff, and Senior engineers.

• Represent Rapid7’s AI engineering efforts to executives, customers, and the external community.

• Shape product, platform, and business strategy.


⛳️ Requirements

• 14+ years of experience in software or ML engineering, including at least 2 years focused on building production LLM or agentic AI systems.

• A PhD in Computer Science, Machine Learning, AI, or a related field is preferred, or an equivalent level of expertise demonstrated through industry experience and technical contributions.

• Proven history of developing scalable, production-grade AI systems and shared platforms utilized across multiple products.

• Cutting-edge knowledge in LLMs, including transformer architecture, attention mechanisms, tokenization, and positional encodings.

• Advanced proficiency in PyTorch, including custom model code, mixed precision, and distributed training (e.g., FSDP, DeepSpeed).

• Practical experience in fine-tuning and post-training of open-weight LLMs, utilizing both full and parameter-efficient methods (LoRA, QLoRA), distillation, and preference or RL-based techniques (e.g., DPO, GRPO).

• Extensive experience with context engineering, retrieval, memory, and context management for long-term agent workflows.

• Familiarity with defining evaluation strategies and benchmarks for LLM and agent systems.

• Profound understanding of inference optimization, including prefill and decode processes, KV-cache management, continuous batching, speculative decoding, and quantization.

• Experience serving models at scale using vLLM, SGLang, or TensorRT-LLM, ideally on AWS, including GPU kernel work (CUDA or Triton).

• Strong foundation in predictive AI, classical ML, distributed systems, and Python.

• Capacity to make efficient and transparent decisions among predictive AI, classical ML, and LLM approaches based on accuracy, latency, and cost considerations.

• Accountability for organization-wide technical outcomes, proactively mitigating systemic risks and eliminating barriers to delivery.

• Influential communication skills to articulate complex architectural trade-offs, foster consensus, and impact technical and product decisions.

• Ability to create alignment across Engineering, Product, and other departments.

• Skill in anticipating evolving customer needs and shaping AI architecture and technical strategy accordingly.

• Capability to thrive amidst ambiguity at the forefront of AI innovation.

• Recognized as an expert in AI, evidenced by publications, patents, open-source contributions, or industry engagement.

• Commitment to the core values of Rapid7.


🏝️ Benefits

• Variable/incentive compensation, equity, and benefits (where applicable/eligible).

• Fair and equitable compensation practices.

• Collaborative work environment that encourages new ideas.

People also viewed

Extend6 hours ago

Senior AI Software Engineer, AI Enablement

US flagUnited States OnlyFull-timeAI Engineer$155k – $170k/year
ApplyView job
OhioHealth6 hours ago

Associate Data and AI Engineer

US flagOhio OnlyFull-timeAI Engineer
ApplyView job
Capital One7 hours ago

Staff AI Engineer

US flagUnited States OnlyFull-timeAI Engineer$244.7k – $279.2k/year
ApplyView job
Software Mind7 hours ago

Tech Lead – AI Prototyping, Python, Full Stack

CR flagCosta Rica OnlyFull-timeAI Engineer
ApplyView job
Terac7 hours ago

Software Developer – AI Assistant Integrations

US flagUnited States OnlyFreelanceAI Engineer
ApplyView job
Homebound7 hours ago

Senior/Staff AI Engineer

US flagUnited States OnlyFull-timeAI Engineer$160k – $220k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers