Software Engineer 3 – GenAI

Posted Nov 12

This is a fully remote position, open to applicants in India.

πŸ“‹ Description

β€’ Design and develop production multi-agent systems, including supervisor/router and specialist agents, LangGraph workflows, tool invocation, conversation memory, and checkpointing.

β€’ Create typed tool contracts and data-access layers over Bidgely APIs to ensure the LLM interprets results rather than merely generating numerical outputs.

β€’ Develop RAG pipelines for utility tariff and knowledge retrieval, employing tenant-isolated embeddings and retrieval mechanisms.

β€’ Oversee latency, reliability, and cost management through strategies such as caching, prewarming, retries, circuit breakers, and model routing.

β€’ Implement guardrails to prevent prompt injection, maintain scope control, manage authorization, ensure tenant isolation, and oversee data management.

β€’ Construct observability and evaluation hooks using LangSmith, collaborating with SDETs on evaluation datasets, regression suites, and release criteria.

β€’ Diagnose agent failures in production environments using traces, logs, and metrics, driving root-cause solutions.

β€’ Facilitate streaming capabilities via WebSocket/SSE and integrate widgets with front-end teams.

β€’ Lead design and code reviews, establish engineering standards, and mentor SDE1 and SDE2 engineers.

β€’ Effectively communicate designs, trade-offs, and project progress to engineering, product teams, and leadership.


⛳️ Requirements

β€’ 6–10 years of experience in software engineering, including a minimum of 1–2 years focused on building and deploying LLM or GenAI features in production.

β€’ Proficient in Python with a solid understanding of Java.

β€’ Practical experience with LangChain, LangGraph, or comparable agent orchestration frameworks.

β€’ Familiarity with LLM APIs (OpenAI, Anthropic, Amazon Bedrock), prompt design, tool/function invocation, and structured outputs.

β€’ Experience in constructing RAG systems using embeddings and vector stores (e.g., pgvector).

β€’ Strong skills in backend and API design, with a track record of creating scalable, low-latency services.

β€’ Experience working with AWS, containers (EKS), PostgreSQL, Redis, and CI/CD processes.

β€’ Familiarity with evals, LLM-as-judge, or AI observability tools such as LangSmith.

β€’ Excellent system design, analytical, and communication abilities.

β€’ Background in time-series, IoT, smart meter data, energy and utilities, voice or IVR GenAI products, multi-tenant SaaS, security, or data privacy is a plus.


🏝️ Benefits

β€’ Remote work arrangement.

β€’ Great Place to Work-certified Bengaluru engineering center.

People also viewed

Helpware9 hours ago

Senior Principal Java Software Engineer

MX flagMexico OnlyFull-timeFull-stack Engineer
ApplyView job
Introhive9 hours ago

Software Engineer Contractor

CA flagCanada OnlyFreelanceFull-stack Engineer
ApplyView job
Boeing9 hours ago

Senior Embedded Software Engineer

US flagUnited States OnlyFull-timeFull-stack Engineer$171.7k – $232.2k/year
ApplyView job
M9 Solutions9 hours ago

HCM Technical Lead

US flagUnited States OnlyFull-timeFull-stack Engineer$225k – $260k/year
ApplyView job
Game Plan Tech9 hours ago

Product Engineer

US flagUnited States OnlyFull-timeFull-stack Engineer
ApplyView job
Airbus10 hours ago

Systems & Software Architect

DE flagGermany OnlyFull-timeFull-stack Engineer
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers