AI Tooling Engineer

This is a fully remote position, open to applicants in India.

📋 Description

• Collaborate with the Principal Engineer in Tooling to develop the platform, introducing new capabilities weekly, from design through to production.

• Integrate new internal systems and SaaS tools into the platform, encompassing APIs, data, shared models, and access permissions.

• Create agents and their associated tools, including MCP servers and the necessary context for delivering high-quality responses.

• Take ownership of evaluation sets, benchmarks, tracing, cost per response, and resolution of issues.

• Transform proofs of concept into secure, production-ready internal cloud tools.

• Utilize AI coding agents with specifications, tests, and reviews to uphold code quality.

• Contribute to company-wide AI tooling projects, including tool assessment and standardization, cost and usage monitoring, and establishing standards for AI-developed internal applications.

• Assist other teams in leveraging the platform effectively.

• Engage with platform users across the organization to prioritize needs and communicate completed work to both technical and non-technical audiences.

⛳️ Requirements

• Over 3 years of experience in building and deploying production software, primarily using Python and relational databases.

• Experience in developing and deploying at least one agent with LangGraph that is actively used by real users: including tool calling, retrieval and embeddings, prompt and context design.

• Practical experience with LLM APIs from leading providers, focusing on cost and token optimization.

• Proficient with MCP or similar tool protocols, both as a server and client.

• Capable of properly evaluating AI systems: creating test sets, using LLMs as evaluators, handling regressions due to prompt or model changes; implementing tracing and observability with Langfuse or similar tools.

• Skilled in integrating APIs and data sources: SaaS APIs, SQL, and data warehouses.

• Familiar with cloud infrastructure (Google Cloud and/or AWS): including containers, managed databases, identity and access management, and CI/CD practices.

• Regularly utilizes AI coding agents and understands how to manage their outputs effectively.

• Possesses a strong sense of security and permissions: ensuring identity management, least privilege access, and visibility controls.

• Comfortable using version control systems (GitHub/Bitbucket).

• Excellent command of written and spoken English, with the ability to communicate effectively with both technical and non-technical stakeholders.

• Knowledgeable in web data or web scraping techniques.

• Experienced with Django and Postgres, including vector search capabilities with pgvector.

• Sufficient frontend skills to develop and modify a chat interface (React, Next.js).

• Demonstrated experience in building internal tools that have been successfully adopted by colleagues.

• Familiarity with semantic layers or knowledge graphs.

• Understanding of memory for agents and multi-agent configurations.

• Previous experience working in remote or distributed teams.

🏝️ Benefits

• Join a self-driven, innovative, and diverse team.

• Enjoy the freedom and flexibility of remote work.

• Work with state-of-the-art, open-source technologies and tools, influencing the AI tooling that supports the entire company.