
Senior AI Software Engineer
Posted 6 hours ago

Posted 6 hours ago
This is a fully remote position, open to applicants in United States.
β’ Develop and implement LLM-based applications and agents, including APIs, backend services, tool invocation, structured outputs, and multi-step workflows.
β’ Create RAG and document processing pipelines that encompass data ingestion, embeddings, vector search, and reranking.
β’ Integrate evaluation processes into every release using test datasets, regression testing, quality metrics, and human assessment.
β’ Collaborate with platform and DevOps engineers to deploy solutions in production utilizing CI/CD, containers, monitoring, and cost management.
β’ Partner with security engineers on access control, audit logging, PII management, AI-action approval procedures, and federal authorization documentation.
β’ Generate technical documentation, architecture diagrams, deployment protocols, and operational runbooks.
β’ Provide guidance to both technical and non-technical stakeholders regarding trade-offs and suggested strategies.
β’ Mentor fellow engineers.
β’ Work alongside developers and government stakeholders to deliver secure and reliable AI solutions within a federal cloud setting.
β’ Bachelor's degree or equivalent professional experience.
β’ Over 7 years of experience in software engineering, including at least 1 year focused on LLM-based applications; or 5+ years in AI or ML application development, with 2+ years dedicated to LLMs.
β’ At least one LLM application developed and maintained in a production environment beyond a basic chat interface.
β’ Familiarity with agent frameworks such as LangGraph, LangChain, Strands Agents, or CrewAI.
β’ Proficient in Python, including API development, backend services, Git, automated testing, and code review.
β’ Experience with leading model providers such as OpenAI, Anthropic, Google, Azure AI, or Amazon Bedrock.
β’ Skilled in deploying and troubleshooting cloud applications using containers and CI/CD practices.
β’ Capability to obtain and maintain a Public Trust clearance.
β’ NACLC (T3) public trust requirement.
β’ US Citizenship is not a requirement.
β’ Preferred: Experience with LLM evaluation, tracing, and prompt versioning tools such as LangSmith, Langfuse, or Ragas.
β’ Preferred: Development and integration experience with Model Context Protocol (MCP) servers.
β’ Preferred: Familiarity with AWS, Amazon Bedrock or Bedrock AgentCore, or relevant AWS certifications.
β’ Preferred: Experience in fine-tuning or customizing foundational models; knowledge in knowledge bases and vector stores.
β’ Preferred: Infrastructure as code experience with Terraform.
β’ Preferred: Knowledge of containerized microservice architectures.
β’ Preferred: Experience supporting scientific research, federal government, healthcare, or similarly regulated domains.
β’ Options for medical plans, including those with Health Savings Accounts.
β’ Dental plan choices.
β’ Vision plan availability.
β’ 401(k) plan with pre-tax and post-tax contributions along with company matching.
β’ Flexible work weeks where feasible.
β’ Paid vacation, sick leave, personal time, holidays, parental leave, military leave, bereavement leave, and jury duty leave.
β’ Generally, 15 days of paid leave each calendar year.
β’ 10 paid holidays annually.
β’ Eligible employees may receive up to 160 hours of paid family leave in a rolling 12-month period.
β’ Short- and long-term disability insurance options.
β’ Life insurance coverage.
β’ Accidental death and dismemberment insurance.
β’ Personal accident insurance.
β’ Critical illness insurance.
β’ Business travel and accident insurance.
EducationSuperHighway
One New Zealand
Conduent
NinjaOne
Get handpicked remote jobs straight to your inbox weekly.