Remotery

Senior Software AI Engineer

Posted Jul 31

This is a fully remote position, open to applicants in Alabama, +31 more states.

📋 Description

• You will design and create scalable APIs for managing agent orchestration and facilitating learner interaction.

• You will develop data pipelines that support agent evaluation and continuous improvement processes.

• You will establish event streaming infrastructure for analyzing real-time learner interactions.

• You will guarantee data quality and accessibility for training and assessing learning agents.

• You will enhance data infrastructure to optimize cost and performance in close collaboration with the Data and ML teams.

• Design and implement robust evaluation frameworks to assess agent performance and improve processes.

• Develop LLM evaluation methodologies and conduct error analysis to pinpoint systemic enhancements for agentic learning systems.

• Support instrumentation that ensures evaluation relevance (metrics, traces/logs, and analysis workflows).

• Participate in on-call rotations and respond to incidents to maintain learning platform reliability.

• Contribute to runbooks, postmortems, and reliability enhancements as we refine our operating model.


⛳️ Requirements

• Over 5 years of production experience with Python at scale.

• Expertise in AWS (including Lambda, DynamoDB, S3, Glue, and Athena).

• Experience with relational databases such as MySQL, PostgreSQL, or Oracle.

• Familiarity with agentic AI architectures and evaluation frameworks.

• Development of data pipelines (both streaming and batch).

• Experience with Infrastructure as Code (CDK, Terraform).

• Experience in production SaaS environments, including on-call participation and incident response.

• Proficiency in GitHub Actions or similar CI/CD tools.

• Experience in effectively communicating updates and resolutions to customers and other stakeholders.

• Active engagement with AI development tools (such as GitHub Copilot, Cursor, Claude Code, Codex) through personal projects and growth over the last year.

• Proven examples of productivity gains through AI augmentation.

• A passion for exploring the frontiers of AI-assisted engineering.


🏝️ Benefits

• Comprehensive medical insurance with low deductibles.

• Affordable dental and vision plans.

• 5 weeks of paid time off, in addition to nearly a dozen paid holidays.

• Employer-sponsored retirement plan.

• Tuition reimbursement program.

• Parental leave benefits.

• Resources for mental health and well-being.

People also viewed

Creative Chaos9 hours ago

Principal AI Engineer

IN flagIndia, +4 more statesFull-timeAI Engineer
ApplyView job
WCG13 hours ago

Senior Director, AI Engineering

US flagUnited States OnlyFull-timeAI Engineer$151.2k – $275k/year
ApplyView job
Ford Motor Company17 hours ago

AI Engineer

MX flagMexico OnlyFull-timeAI Engineer
ApplyView job
Carbon6018 hours ago

Principal Data, AI Architect

CA flagCanada OnlyFull-timeAI EngineerC$180k – C$220k/year
ApplyView job
WorkHero19 hours ago

Senior Software Engineer, AI Full Stack

US flagUnited States OnlyFull-timeAI Engineer
ApplyView job
DNI (Delaware Nation Industries)20 hours ago

AI Developer, Engineer

US flagOregon OnlyFull-timeAI Engineer
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers