AI / LLM Integration Engineer

📋 Description

• Create and refine prompts that effectively interpret flagged reconciliation exceptions and produce structured, actionable resolution recommendations with confidence scoring.

• Integrate LLM APIs (Anthropic Claude, OpenAI) into the exception resolution layer using Python, the Anthropic SDK, and asynchronous API patterns for reliable, production-grade performance.

• Develop workflows that incorporate human oversight, balancing automation with human input to ensure financial accuracy and auditability throughout the process.

• Construct robust API integration code that effectively manages edge cases, rate limiting, token management, and smooth error recovery in a financial context.

• Collaborate with backend developers to seamlessly incorporate AI outputs into the reconciliation pipeline, ensuring smooth data flow into final reports.

• Establish LLM evaluation and benchmarking frameworks to assess prompt effectiveness, accuracy, and consistency across various exception types.

• Document prompt strategies and model behaviors to facilitate knowledge sharing and ongoing improvement within the engineering team.

• Monitor and refine model performance, adjusting prompts and integration logic based on real-world exception data and user feedback.

⛳️ Requirements

• A minimum of 3 years of professional software engineering experience, including at least 2 years of direct work with LLM APIs (Anthropic, OpenAI, or comparable).

• Strong proficiency in Python, with practical experience using the Anthropic SDK and making async API calls.

• Proven expertise in prompt engineering, especially for structured outputs and specialized domain tasks.

• Solid understanding of confidence scoring, uncertainty quantification, and workflows that include human oversight in AI.

• Experience in writing clean, maintainable API integration code with a focus on edge cases and effective error handling.

• Capability to work independently while effectively communicating with cross-functional teams.

• Familiarity with financial systems, reconciliation processes, or similar regulated domains is advantageous.

🏝️ Benefits

• Flexible work environment: Enjoy 100% remote work with a collaborative and inclusive team culture.

• Meaningful impact: Contribute to cutting-edge AI solutions that significantly enhance financial operations for our clients.

• Professional growth: Opportunities to deepen your expertise in LLMs, agentic AI, and financial technology.

• Competitive compensation: Salary commensurate with experience and current market rates.

• Collaborative culture: Work alongside talented engineers and product teams who prioritize innovation and continuous learning.