
Senior Software AI Engineer
Posted Jul 31

Posted Jul 31
This is a fully remote position, open to applicants in Alabama, +31 more states.
• You will design and create scalable APIs for managing agent orchestration and facilitating learner interaction.
• You will develop data pipelines that support agent evaluation and continuous improvement processes.
• You will establish event streaming infrastructure for analyzing real-time learner interactions.
• You will guarantee data quality and accessibility for training and assessing learning agents.
• You will enhance data infrastructure to optimize cost and performance in close collaboration with the Data and ML teams.
• Design and implement robust evaluation frameworks to assess agent performance and improve processes.
• Develop LLM evaluation methodologies and conduct error analysis to pinpoint systemic enhancements for agentic learning systems.
• Support instrumentation that ensures evaluation relevance (metrics, traces/logs, and analysis workflows).
• Participate in on-call rotations and respond to incidents to maintain learning platform reliability.
• Contribute to runbooks, postmortems, and reliability enhancements as we refine our operating model.
• Over 5 years of production experience with Python at scale.
• Expertise in AWS (including Lambda, DynamoDB, S3, Glue, and Athena).
• Experience with relational databases such as MySQL, PostgreSQL, or Oracle.
• Familiarity with agentic AI architectures and evaluation frameworks.
• Development of data pipelines (both streaming and batch).
• Experience with Infrastructure as Code (CDK, Terraform).
• Experience in production SaaS environments, including on-call participation and incident response.
• Proficiency in GitHub Actions or similar CI/CD tools.
• Experience in effectively communicating updates and resolutions to customers and other stakeholders.
• Active engagement with AI development tools (such as GitHub Copilot, Cursor, Claude Code, Codex) through personal projects and growth over the last year.
• Proven examples of productivity gains through AI augmentation.
• A passion for exploring the frontiers of AI-assisted engineering.
• Comprehensive medical insurance with low deductibles.
• Affordable dental and vision plans.
• 5 weeks of paid time off, in addition to nearly a dozen paid holidays.
• Employer-sponsored retirement plan.
• Tuition reimbursement program.
• Parental leave benefits.
• Resources for mental health and well-being.
Creative Chaos
WCG
Ford Motor Company
Carbon60
Get handpicked remote jobs straight to your inbox weekly.