
Software Engineer 3 β GenAI
Posted Nov 12

Posted Nov 12
This is a fully remote position, open to applicants in India.
β’ Design and develop production multi-agent systems, including supervisor/router and specialist agents, LangGraph workflows, tool invocation, conversation memory, and checkpointing.
β’ Create typed tool contracts and data-access layers over Bidgely APIs to ensure the LLM interprets results rather than merely generating numerical outputs.
β’ Develop RAG pipelines for utility tariff and knowledge retrieval, employing tenant-isolated embeddings and retrieval mechanisms.
β’ Oversee latency, reliability, and cost management through strategies such as caching, prewarming, retries, circuit breakers, and model routing.
β’ Implement guardrails to prevent prompt injection, maintain scope control, manage authorization, ensure tenant isolation, and oversee data management.
β’ Construct observability and evaluation hooks using LangSmith, collaborating with SDETs on evaluation datasets, regression suites, and release criteria.
β’ Diagnose agent failures in production environments using traces, logs, and metrics, driving root-cause solutions.
β’ Facilitate streaming capabilities via WebSocket/SSE and integrate widgets with front-end teams.
β’ Lead design and code reviews, establish engineering standards, and mentor SDE1 and SDE2 engineers.
β’ Effectively communicate designs, trade-offs, and project progress to engineering, product teams, and leadership.
β’ 6β10 years of experience in software engineering, including a minimum of 1β2 years focused on building and deploying LLM or GenAI features in production.
β’ Proficient in Python with a solid understanding of Java.
β’ Practical experience with LangChain, LangGraph, or comparable agent orchestration frameworks.
β’ Familiarity with LLM APIs (OpenAI, Anthropic, Amazon Bedrock), prompt design, tool/function invocation, and structured outputs.
β’ Experience in constructing RAG systems using embeddings and vector stores (e.g., pgvector).
β’ Strong skills in backend and API design, with a track record of creating scalable, low-latency services.
β’ Experience working with AWS, containers (EKS), PostgreSQL, Redis, and CI/CD processes.
β’ Familiarity with evals, LLM-as-judge, or AI observability tools such as LangSmith.
β’ Excellent system design, analytical, and communication abilities.
β’ Background in time-series, IoT, smart meter data, energy and utilities, voice or IVR GenAI products, multi-tenant SaaS, security, or data privacy is a plus.
β’ Remote work arrangement.
β’ Great Place to Work-certified Bengaluru engineering center.
Helpware
Introhive
Boeing
M9 Solutions
Get handpicked remote jobs straight to your inbox weekly.