
AI Engineer
Posted 14 hours ago

Posted 14 hours ago
This is a fully remote position, open to applicants in Europe.
• Develop the agentic runtime for proactive AI agents.
• Create components for context-building, tool/retrieval orchestration, scoring, and guardrails.
• Take ownership of production components from the outset.
• Enhance grounding and product-availability accuracy through retrieval, prompting, and evaluation.
• Integrate exact-match and semantic search into a unified ranking system.
• Elevate multilingual response quality across Italian, English, and additional languages.
• Analyze requests to optimize latency and cost.
• Evaluate prompt and model adjustments and quantify enhancements.
• Refine evaluation systems utilizing Langfuse traces and a golden-dataset harness.
• Rank, score, and manage proactive insights to ensure agents only engage customers when necessary.
• Contribute to screening, technical case studies, founder and team interviews, reference checks, and hiring processes.
• A minimum of 2 years of professional software shipping experience.
• Experience with at least one production LLM feature utilized by real users, such as a chatbot, RAG system, or agent.
• Familiarity with RAG concepts, including embeddings, vector search, chunking, and reranking.
• Proficient in analyzing production traces to identify issues related to retrieval, prompting, or tool selection.
• Experience with LLM observability or evaluation tools such as Langfuse, LangSmith, Braintrust, Arize, or Humanloop.
• Strong fundamentals in Python and backend development.
• Capable of measuring latency, cost, and quality metrics.
• Preferred: experience with Elastic, Algolia, Qdrant, Weaviate, fine-tuning, graph search, and e-commerce operations.
• Must be able to work from a European country without requiring visa sponsorship.
• Genuine ownership from day one.
• Opportunity to collaborate with exceptional international talent.
• Growth opportunities with roles and responsibilities that expand based on proven capabilities.
• A close-knit, supportive team environment.
• An equal opportunity employer.
Rapid7
Rapid7
Get handpicked remote jobs straight to your inbox weekly.