Senior Software Engineer, AI Platform

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, develop, and manage production AI agents, including an autonomous coding agent that operates using Jira and Slack.

• Create the retrieval and context layer by utilizing embeddings, semantic search, knowledge-graph modeling, the Snowflake semantic layer, and internal documentation.

• Enhance the internal MCP server with reusable skills, tools, and processes.

• Assist product teams in integrating agents into their existing workflows.

• Develop offline test sets and online metrics to assess prompts, models, and retrieval modifications, as well as gate releases.

• Minimize model costs and latency through routing, caching, and structured outputs; monitor expenses on AWS Bedrock.

• Protect agents from prompt injection, memory poisoning, and excessive permissions.

• Equip agents with tracing and logging capabilities, troubleshoot failures, and participate in on-call duties.

• Assess and adopt effective models and tools.

• Draft design documents, review code, and mentor engineers on implementing LLMs.

⛳️ Requirements

• Bachelor's degree or equivalent practical experience.

• A minimum of 6 years of professional software development experience, including taking ownership of production services from start to finish.

• At least 1 year of hands-on experience in delivering LLM-powered features or agents to production.

• Proficient in tool/function calling, prompt design, structured outputs, and effectively managing model failures.

• Experience in building retrieval systems, including embeddings, vector or hybrid search, chunking and ranking, and assessing retrieval quality.

• Strong expertise in at least one of Python, TypeScript, or Ruby, with comfort in navigating a polyglot codebase.

• Familiarity with a major cloud platform, preferably AWS, along with CI/CD and observability tools.

• Proven track record of measuring the impact of your work through evaluations, A/B tests, or clear before-and-after metrics.

🏝️ Benefits

• Medical, dental, and vision coverage.

• 100% employer-paid premium for employees.

• Up to 80% coverage for dependents.

• Company HSA contribution available with the High Deductible Health Plan.

• 401(k) retirement plan with employer matching up to 3.5% of employee contributions.

• Basic Life, Voluntary Life, and AD&D Insurance options.

• Student Loan Repayment/529 Education Savings with a monthly contribution from the company.

• FSA (Medical, Dependent, Transit, and Parking).

• Critical Illness Insurance.

• Accident Insurance.

• Short- and Long-term Disability Insurance.

• Pet Insurance.

• Identity theft protection.

• Legal access to a network of attorneys.

• Paid time off, sick leave, and company holidays, including a holiday shutdown in 2026.

• Paid parental leave.

• Competitive bonus.