
Senior Software Engineer, AI Developer Experience
Posted 2 days ago

Posted 2 days ago
This is a fully remote position, open to applicants in United States.
• Design, construct, and enhance the background-agent infrastructure to ensure automated engineering work is reliable, trackable, and repeatable.
• Create systems to assess agent performance based on task outcomes, quality metrics, human intervention, costs, and various other indicators.
• Develop evaluation sets and feedback mechanisms to enhance AI systems through analysis, tuning, and corrections.
• Enhance the discovery, comprehension, and utilization of shared AI tools and workflows by engineers.
• Assess AI development tools, such as code generation, AI-assisted reviews, and testing, in relation to actual engineering requirements.
• Assist in the integration of beneficial AI development tools.
• Establish visibility into valuable tools and workflows, identify friction points, and suggest their evolution.
• Produce guidance and documentation for AI-enhanced development methodologies.
• Optimize code review processes by incorporating feedback from real engineering practices.
• Contribute to the foundations of an autonomous software factory, including systems that aid agents in safely and effectively completing bounded engineering tasks.
• Collaborate with engineers and internal users to grasp their needs, validate solutions, and navigate product trade-offs.
• Transition ambiguous, dependency-laden projects from exploration to dependable delivery.
• Elevate quality through code reviews, technical design discussions, testing, observability, reliability, and security measures.
• Collaborate with engineers and cross-functional partners.
• Extensive experience in software engineering within the industry.
• Proven experience in taking on technical leadership roles within teams or on complex projects.
• Background in enhancing AI systems, creating evaluation sets, and driving quality improvements through measurement and iteration.
• Strong foundational knowledge in software engineering, with experience in designing, building, testing, and maintaining reliable systems.
• Familiarity with developer tooling, AI-driven workflows, agent-based systems, infrastructure, or related technical areas.
• Demonstrated ability to navigate ambiguity, break down complex issues, manage dependencies, and drive projects to completion.
• Experience in fast-growing startups or larger companies, particularly in environments with a strong action-oriented culture.
• Action-driven mindset and readiness to engage directly with users while contributing hands-on.
• Strong product judgment and curiosity.
• Excellent written and verbal communication skills, with the ability to clearly explain technical concepts and produce guidance that aids others in adopting new tools.
• Collaborative mindset and proven ability to make significant contributions as part of a team.
• Utilizes AI in daily tasks to enhance skills and improve outcomes.
• Eligibility to work legally in the U.S. location where the position is based.
• Competitive salary and equity aligned with industry standards.
• Comprehensive medical, dental, and vision coverage, with 100% of employee-only premiums covered for most medical plans.
• 16 weeks of paid Parental Leave for all new parents.
• Health & wellness stipend.
• Stipend for remote workspace, internet, and cellphone expenses.
• Commuter benefits for team members commuting to the SF and NYC offices.
• Family planning benefits available.
• 401(k) matching contributions with immediate vesting.
• Flexible PTO policy alongside 80 hours of Sick Time.
• 11 company-paid holidays throughout the year.
• Opportunities for virtual team-building activities, lunch and learns, and other company-wide events.
Vanta
Twilio
Niobium Microsystems
Smartsheet
Get handpicked remote jobs straight to your inbox weekly.