Remotery

Senior Software Engineer, Applied AI

Posted 2 days ago

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop the agent platform and tools, encompassing orchestration, function/tool integration, evaluation frameworks, prompt/version management, tracing/observability, and safety protocols.

• Facilitate retrieval-augmented generation (RAG), structured extraction, and production inference processes.

• Collaborate with application engineering teams to integrate AI into software development workflows, including code review support, test generation, incident resolution, and developer assistants.

• Determine the tasks to be delegated to agents versus those to be handled by humans, define agent responsibilities, and adjust boundaries as tooling evolves.

• Analyze agent performance based on traces, intermediate actions, inputs, and failure points.

• Validate AI-generated outputs and tests prior to trust or deployment.

• Oversee applied AI initiatives from initial prototype to production, addressing data requirements, system architecture, model/vendor selection, deployment, monitoring, and iterative improvements.

• Collaborate with product, design, and data/ML teams to achieve customer-focused outcomes.

• Evaluate AI adoption across teams, pinpoint bottlenecks and failure modes, develop necessary capabilities, instruct on existing tools, and promote adoption.

• Establish engineering standards for reliability, evaluation, incident management, privacy/security, and AI development.

• Guide engineers through design assessments, collaborative work, and practical technical leadership.

• Mentor colleagues and enhance engineering quality across the organization.


⛳️ Requirements

• Minimum of 6 years of professional software engineering experience, including deploying production systems.

• Hands-on experience on an Applied AI or product AI team developing LLM- or ML-driven features.

• Proven ability in agent-driven development, including task delegation, agent context/scoping, and output verification.

• Strong skills in backend and system design.

• Familiarity with APIs, distributed systems, queues/workflows, observability, and performance metrics.

• Capability to navigate uncertainty and drive results with product, design, data/ML, and platform partners.

• History of mentoring colleagues and enhancing engineering standards.

• Authorization to work for any employer in the U.S.; sponsorship for employment visas is not available.

• Experience with platform features for engineers, embeddings, search/retrieval, evaluation techniques, model monitoring, AI agents/assistants at scale, inference limitations, vendor/model considerations, and deployment strategies is a plus.


🏝️ Benefits

• Company-subsidized medical, dental, & vision insurance plans.

• 401(k) plan with company matching contributions.

• Annual bonus opportunities.

• Flexible PTO to promote a healthy work/life balance (2 weeks STRONGLY encouraged!).

• Generous paid leave options, including 16 weeks of paid parental leave and disability support.

• Flexible workplace arrangements and modern work schedules focused on achieving results rather than just hours worked.

• Company-wide in-person gatherings and team outings.

• Lifestyle enhancement initiatives.

• Company-provided equipment (Windows & Mac choices).

• Annual performance evaluations with pathways for growth and career advancement.

People also viewed

Sigma Software Group6 hours ago

Principal Software Engineer

UA flagUkraine OnlyFull-timeFull-stack Engineer
ApplyView job
Collectly6 hours ago

Senior Software Engineer – Pre Service Team

RS flagSerbia OnlyFull-timeFull-stack Engineer
ApplyView job
ioet6 hours ago

Senior Product Engineer

Latin AmericaFull-timeFull-stack Engineer
ApplyView job
Allata6 hours ago

FullStack Developer, Java, Vue

US flagTexas OnlyFull-timeFull-stack Engineer
ApplyView job
hatch I.T.6 hours ago

Senior Full Stack Developer

US flagDistrict of Columbia, +1 more stateFull-timeFull-stack Engineer
ApplyView job
CVS Health6 hours ago

Senior Manager – Epic EHR Development Lead, Software Development

US flagMassachusetts OnlyFull-timeFull-stack Engineer$130.3k – $260.6k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers