Senior AI Engineer

This is a fully remote position, open to applicants in India.

📋 Description

• Design, create, and uphold production-quality LLM integration pipelines, which encompass retrieval-augmented generation (RAG), prompt engineering, output processing, and chain orchestration.

• Develop and manage AI functionalities within Jeeves's core financial offerings, including spend categorization, document extraction, anomaly detection, financial Q&A, and automated reconciliation.

• Execute structured output validation, fallback mechanisms, and confidence scoring to guarantee that AI decisions adhere to reliability standards for financial applications.

• Assess and incorporate AI frameworks and tools (LangChain, LlamaIndex, OpenAI API, Anthropic API, HuggingFace, vector databases) while advocating for the most suitable tool for each task.

• Establish practices for prompt versioning and evaluation to maintain the accuracy and consistency of AI outputs as models and data evolve.

• Design and sustain vector search pipelines utilizing databases like Pinecone, Weaviate, or pgvector to enhance semantic search and RAG-based features.

• Construct document ingestion and chunking pipelines for Jeeves's financial data, processing invoices, receipts, policy documents, and transaction records.

• Enhance retrieval quality through the selection of embedding models, chunk strategies, metadata filtering, and re-ranking techniques.

• Collaborate with data scientists to transition trained ML models from experimental notebooks to production serving infrastructure.

• Build and maintain model serving endpoints ensuring appropriate latency service level objectives (SLOs), input validation, and output monitoring.

• Implement monitoring of model performance and detection of data drift to ensure production models remain accurate over time.

• Assist in model retraining workflows by designing robust data pipelines and feature engineering that can be continuously updated.

• Seamlessly integrate AI services with Jeeves's backend microservices by designing clear API contracts, circuit breakers, and graceful degradation patterns.

• Write high-quality, testable backend code in Python or Go/Node.js to enable AI-integrated features.

• Instrument AI components with structured logging, distributed tracing, latency dashboards, and alerting mechanisms to ensure operational visibility.

• Develop human-in-the-loop review workflows for AI decisions requiring oversight, particularly for high-stakes financial actions.

• Collaborate with Product, Backend Engineering, and Data Science teams to define the AI roadmap and translate requirements into reliable systems.

• Foster a culture of quality by drafting design documents, reviewing peers' AI system designs, and sharing insights openly.

• Contribute to the growth of the AI engineering practice at Jeeves by establishing patterns, tools, and best practices that the broader team can leverage.

⛳️ Requirements

• Bachelor's degree in Computer Science, Engineering, or a related discipline — or equivalent practical experience.

• Over 5 years of professional software engineering experience, with a minimum of 3 years concentrated on AI/ML systems in production.

• Practical experience in building and deploying LLM-powered applications utilizing APIs such as OpenAI, Anthropic, or Cohere in a production setting.

• Experience in designing and operating RAG pipelines, including chunking strategies, embedding models, and vector database integration (Pinecone, Weaviate, pgvector, or similar).

• Strong expertise in Python for AI/ML tasks; familiarity with at least one AI orchestration framework (LangChain, LlamaIndex, or equivalent).

• Experience with ML model serving infrastructure, including REST or gRPC inference endpoints, input/output validation, latency budgeting, and monitoring.

• Solid foundation in backend engineering principles: REST APIs, relational databases (PostgreSQL preferred), asynchronous patterns, and cloud infrastructure (AWS, GCP, or Azure).

• Familiarity with observability tools: structured logging, distributed tracing, and creating dashboards for AI system health.

🏝️ Benefits

• Opportunity to work in a dynamic and innovative environment.

• Competitive salary and equity options.

• Comprehensive health, dental, and vision insurance.

• Flexible work hours and remote work options.

• A culture that encourages personal and professional growth.