Senior Software Engineer, AI Automation

This is a fully remote position, open to applicants in United States.

📋 Description

• Oversee the technical design and implementation of AI agents, reusable skills, and automation workflows utilized by Coalition’s internal teams.

• Convert complex and ambiguous business processes, decision-making scenarios, and edge cases into dependable, maintainable software solutions.

• Design and enhance integrations between agents and systems of record utilizing MCP and similar tool-integration frameworks.

• Specify architecture, interfaces, data contracts, and operational standards for production-grade AI systems.

• Develop evaluation strategies, quality benchmarks, and release criteria; leverage results to make informed deployment and iteration choices.

• Create systems with strong controls for permissions, observability, auditability, human-in-the-loop reviews, failure containment, and rollback mechanisms.

• Collaborate with data engineering and business stakeholders to ensure that automations are based on reliable data and have sustainable ownership.

• Propel technical decisions across various workflows, identify reusable patterns, and enhance the engineering standards for the team.

• Guide engineers and technical partners through design assessments, implementation support, and practical AI engineering practices.

• Maintain documentation for systems, decisions, and operational procedures, enabling teams to safely manage and expand upon your contributions.

⛳️ Requirements

• A minimum of 7 years of hands-on software engineering experience, with significant recent involvement in developing and delivering LLM-backed applications for real users.

• Proven experience in transitioning AI agents or multi-step automation workflows from prototype stages to reliable production environments.

• Proficient Python engineering skills coupled with practical SQL knowledge, including the capability to interact directly with production data models.

• Extensive experience with prompting, tool utilization, agentic loops, structured outputs, multi-step workflows, error management, and production deployment.

• Background in designing and managing systems that integrate with critical business systems of record.

• Strong judgment regarding evaluation methodologies, reliability, safety protocols, and the necessary trade-offs for responsible AI system deployment.

• Solid understanding of production engineering fundamentals across Git, CI/CD, containers, deployment, monitoring, testing, permissions, and rollback strategies.

• Capacity to lead technical initiatives in ambiguous settings, influence stakeholders, and transform incomplete requirements into effective, high-quality solutions.

• Excellent written and verbal communication skills, with the ability to engage effectively with both technical and non-technical partners.

• Experience in building or maintaining MCP servers, agent platforms, or reusable tool/skill frameworks.

• Experience in designing evaluation harnesses, test datasets, and monitoring systems for LLM-backed architectures.

• Background in internal tools, solutions engineering, professional services, startup environments, or founding teams.

• Familiarity with systems such as Linear, Jira, Zendesk, Salesforce, or Snowflake.

• Experience in regulated sectors like insurance, fintech, or cybersecurity, where correctness, traceability, and controls significantly impact business outcomes.

• Experience mentoring engineers or serving as a technical lead for complex cross-functional projects.

🏝️ Benefits

• 100% coverage for medical, dental, and vision insurance.

• 401(k) retirement plan with a competitive employer matching program.

• Flexible paid time off (PTO).

• Up to 14 weeks of paid leave for birthing parents and 8 weeks of paid parental leave for non-birthing parents.

• Annual stipend for home office expenses and access to WeWork locations.

• Wellness programs for mental and physical health, including One Medical, Headspace, Wellhub, and more!

• Competitive salary with opportunities for career advancement.

• A remote-first work environment with a highly inclusive culture.