Senior AI Software Engineer

Posted 6 hours ago

This is a fully remote position, open to applicants in United States.

πŸ“‹ Description

β€’ Develop and implement LLM-based applications and agents, including APIs, backend services, tool invocation, structured outputs, and multi-step workflows.

β€’ Create RAG and document processing pipelines that encompass data ingestion, embeddings, vector search, and reranking.

β€’ Integrate evaluation processes into every release using test datasets, regression testing, quality metrics, and human assessment.

β€’ Collaborate with platform and DevOps engineers to deploy solutions in production utilizing CI/CD, containers, monitoring, and cost management.

β€’ Partner with security engineers on access control, audit logging, PII management, AI-action approval procedures, and federal authorization documentation.

β€’ Generate technical documentation, architecture diagrams, deployment protocols, and operational runbooks.

β€’ Provide guidance to both technical and non-technical stakeholders regarding trade-offs and suggested strategies.

β€’ Mentor fellow engineers.

β€’ Work alongside developers and government stakeholders to deliver secure and reliable AI solutions within a federal cloud setting.


⛳️ Requirements

β€’ Bachelor's degree or equivalent professional experience.

β€’ Over 7 years of experience in software engineering, including at least 1 year focused on LLM-based applications; or 5+ years in AI or ML application development, with 2+ years dedicated to LLMs.

β€’ At least one LLM application developed and maintained in a production environment beyond a basic chat interface.

β€’ Familiarity with agent frameworks such as LangGraph, LangChain, Strands Agents, or CrewAI.

β€’ Proficient in Python, including API development, backend services, Git, automated testing, and code review.

β€’ Experience with leading model providers such as OpenAI, Anthropic, Google, Azure AI, or Amazon Bedrock.

β€’ Skilled in deploying and troubleshooting cloud applications using containers and CI/CD practices.

β€’ Capability to obtain and maintain a Public Trust clearance.

β€’ NACLC (T3) public trust requirement.

β€’ US Citizenship is not a requirement.

β€’ Preferred: Experience with LLM evaluation, tracing, and prompt versioning tools such as LangSmith, Langfuse, or Ragas.

β€’ Preferred: Development and integration experience with Model Context Protocol (MCP) servers.

β€’ Preferred: Familiarity with AWS, Amazon Bedrock or Bedrock AgentCore, or relevant AWS certifications.

β€’ Preferred: Experience in fine-tuning or customizing foundational models; knowledge in knowledge bases and vector stores.

β€’ Preferred: Infrastructure as code experience with Terraform.

β€’ Preferred: Knowledge of containerized microservice architectures.

β€’ Preferred: Experience supporting scientific research, federal government, healthcare, or similarly regulated domains.


🏝️ Benefits

β€’ Options for medical plans, including those with Health Savings Accounts.

β€’ Dental plan choices.

β€’ Vision plan availability.

β€’ 401(k) plan with pre-tax and post-tax contributions along with company matching.

β€’ Flexible work weeks where feasible.

β€’ Paid vacation, sick leave, personal time, holidays, parental leave, military leave, bereavement leave, and jury duty leave.

β€’ Generally, 15 days of paid leave each calendar year.

β€’ 10 paid holidays annually.

β€’ Eligible employees may receive up to 160 hours of paid family leave in a rolling 12-month period.

β€’ Short- and long-term disability insurance options.

β€’ Life insurance coverage.

β€’ Accidental death and dismemberment insurance.

β€’ Personal accident insurance.

β€’ Critical illness insurance.

β€’ Business travel and accident insurance.

People also viewed

EducationSuperHighway5 hours ago

Senior Software Engineer – Contract

US flagUnited States OnlyFreelanceFull-stack Engineer
ApplyView job
One New Zealand5 hours ago

Core Network DevOps Principal Engineer

NZ flagNew Zealand OnlyFull-timeFull-stack Engineer
ApplyView job
Conduent5 hours ago

Senior Defined Benefits Technical Lead Analyst

US flagUnited States OnlyFull-timeFull-stack Engineer$85k – $95k/year
ApplyView job
NinjaOne5 hours ago

Senior Software Engineer, Java

US flagCalifornia, +17 more statesFull-timeFull-stack Engineer$160k – $200k/year
ApplyView job
NinjaOne5 hours ago

Senior Software Engineer, Java – Patching

US flagCalifornia, +16 more statesFull-timeFull-stack Engineer$160k – $220k/year
ApplyView job
NinjaOne5 hours ago

Senior Software Engineer, Java – Patching

US flagCalifornia, +17 more statesFull-timeFull-stack Engineer$140k – $200k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers