
Senior Software Engineer, Applied AI
Posted 2 days ago

Posted 2 days ago
This is a fully remote position, open to applicants in United States.
• Develop the agent platform and tools, encompassing orchestration, function/tool integration, evaluation frameworks, prompt/version management, tracing/observability, and safety protocols.
• Facilitate retrieval-augmented generation (RAG), structured extraction, and production inference processes.
• Collaborate with application engineering teams to integrate AI into software development workflows, including code review support, test generation, incident resolution, and developer assistants.
• Determine the tasks to be delegated to agents versus those to be handled by humans, define agent responsibilities, and adjust boundaries as tooling evolves.
• Analyze agent performance based on traces, intermediate actions, inputs, and failure points.
• Validate AI-generated outputs and tests prior to trust or deployment.
• Oversee applied AI initiatives from initial prototype to production, addressing data requirements, system architecture, model/vendor selection, deployment, monitoring, and iterative improvements.
• Collaborate with product, design, and data/ML teams to achieve customer-focused outcomes.
• Evaluate AI adoption across teams, pinpoint bottlenecks and failure modes, develop necessary capabilities, instruct on existing tools, and promote adoption.
• Establish engineering standards for reliability, evaluation, incident management, privacy/security, and AI development.
• Guide engineers through design assessments, collaborative work, and practical technical leadership.
• Mentor colleagues and enhance engineering quality across the organization.
• Minimum of 6 years of professional software engineering experience, including deploying production systems.
• Hands-on experience on an Applied AI or product AI team developing LLM- or ML-driven features.
• Proven ability in agent-driven development, including task delegation, agent context/scoping, and output verification.
• Strong skills in backend and system design.
• Familiarity with APIs, distributed systems, queues/workflows, observability, and performance metrics.
• Capability to navigate uncertainty and drive results with product, design, data/ML, and platform partners.
• History of mentoring colleagues and enhancing engineering standards.
• Authorization to work for any employer in the U.S.; sponsorship for employment visas is not available.
• Experience with platform features for engineers, embeddings, search/retrieval, evaluation techniques, model monitoring, AI agents/assistants at scale, inference limitations, vendor/model considerations, and deployment strategies is a plus.
• Company-subsidized medical, dental, & vision insurance plans.
• 401(k) plan with company matching contributions.
• Annual bonus opportunities.
• Flexible PTO to promote a healthy work/life balance (2 weeks STRONGLY encouraged!).
• Generous paid leave options, including 16 weeks of paid parental leave and disability support.
• Flexible workplace arrangements and modern work schedules focused on achieving results rather than just hours worked.
• Company-wide in-person gatherings and team outings.
• Lifestyle enhancement initiatives.
• Company-provided equipment (Windows & Mac choices).
• Annual performance evaluations with pathways for growth and career advancement.
Sigma Software Group
Collectly
Allata
Get handpicked remote jobs straight to your inbox weekly.