
AI Engineer
Posted 1 day ago

Posted 1 day ago
This is a fully remote position, open to applicants in United States.
• Design, develop, and sustain AI systems that transform customer interactions and uploaded documents into reliable, verifiable cost estimates.
• Create and oversee LangGraph agents, which include ReAct retrieval sub-agents, custom middleware, Pydantic-typed graph state, and streaming flows.
• Manage retrieval quality comprehensively through collection routing, LLM-driven metadata filters, similarity thresholds, query rewriting, semantic chunking, and citation tracking.
• Integrate AWS Bedrock, OpenAI, and self-hosted vLLM behind a unified interface.
• Develop and maintain API services, relational and domain-knowledge data stores, vector stores, and AI workflow observability/tracing.
• Establish technical direction for the AI workstream.
• Review designs and code, mentor engineers, and engage with product stakeholders.
• Execute against the roadmap while enhancing agent success, retrieval accuracy, grounding, latency, and LLM cost-efficiency.
• Bachelor's degree in Computer Science, Software Engineering, Data Science, or Mathematics.
• At least 6 years of progressive experience in software engineering.
• A minimum of 1 year working with production LLM-powered or machine-learning systems, including agents, RAG, or prompt/evaluation pipelines.
• Proven success in a dynamic, fast-paced environment.
• Availability to overlap with U.S./Eastern-Time business hours for client meetings.
• Extensive experience in production software engineering and LLM-powered systems.
• Expertise in agents/orchestration, retrieval-augmented generation, and prompt/evaluation pipelines.
• Proficiency in utilizing AI development tools.
• In-depth understanding of retrieval and grounding, embeddings and vector search, multi-model integration, and cost/latency optimization.
• Familiarity with the cost-estimation/Work Breakdown Structure domain, or the ability to quickly acquire in-depth knowledge.
• Capability to analyze complex, non-deterministic AI behaviors from production traces and deliver scalable, thoroughly-tested solutions.
• Exceptional skill in communicating technical and model-behavior concepts to non-technical and client stakeholders.
• Confidence in participating in live U.S./ET client meetings and maintaining disciplined asynchronous written communication across time zones.
• Proven ability to make critical, time-sensitive decisions with limited information.
• High level of ownership, motivation, a proactive approach, and a willingness to go the extra mile.
• Flexible working arrangements.
• Opportunities for long-term professional development.
• A collaborative, trust-oriented, and quality-focused work environment.
• Autonomy combined with accountability and the ability to influence architecture, technical direction, and standards.
Rapid7
Rapid7
Get handpicked remote jobs straight to your inbox weekly.