Staff Software Engineer, Applied AI

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and develop internal tools and platforms for operational teams, overseeing the process from initial design to deployment and ongoing management.

• Take ownership of reliability and ensure proper incident management.

• Establish service boundaries, integration patterns, data flows, technical strategies, and RFCs across various teams.

• Minimize operational burden through system decommissioning, consolidation, management of technical debt, and migrations.

• Create dependable integrations with legacy systems and third-party SaaS that include security measures, access controls, and audit trails.

• Identify suitable applications for AI and design features for retrieval, agent, LLM-powered systems, and workflow automation.

• Conduct time-boxed proofs of concept and transition successful projects into production-ready solutions, ensuring evaluation, observability, reliability, and security are prioritized.

• Evaluate AI maturity, establish a practical roadmap, and monitor AI costs and return on investment (ROI).

• Develop data models and instrumentation that yield clean, actionable analytics data.

• Coordinate teams on shared platforms, standards, and trade-offs amidst competing priorities.

• Facilitate code reviews, design reviews, and adherence to engineering standards, utilizing AI coding tools like Claude Code and GitHub Copilot.

• Guide engineers and provide insights to stakeholders and leadership regarding technical trade-offs and decisions.

⛳️ Requirements

• Over 10 years of professional experience in software engineering.

• Scope at the Staff or Principal level, encompassing leadership in architecture or significant technical projects across multiple teams.

• Practical experience in developing applications that utilize LLMs and generative AI in a production environment.

• Experience in operating AI systems at scale and assessing outcomes.

• Proven track record of deploying agentic systems into production, including evaluation, safeguards, and monitoring mechanisms.

• Strong skills in backend and systems design, covering APIs, data modeling, cloud infrastructure, and integrations with legacy and third-party SaaS.

• Background in reliability engineering, including SLOs, idempotency, retries, handling partial failures, and maintaining data consistency.

• Experience in building systems that manage sensitive information, ensuring proper access control, audit trails, and handling of PII and privileged data.

• Familiarity with strategies for managing technical debt, migrations, and system deprecation.

• Expertise in designing data models and instrumentation for analytics purposes.

• Knowledge of RAG, embeddings, vector search, prompts, harnesses, context engineering, tool usage, agents, and evaluation techniques.

• Ability to assess build-versus-buy decisions in relation to cost, complexity, and business value.

• Excellent communication skills, including the capability to explain AI concepts to non-technical audiences and drive decisions to completion.

• Preferred: experience with vector databases and search technologies.

• Preferred: familiarity with modern data stacks like BigQuery, Snowflake, or dbt.

• Preferred: background in developing internal tools or platforms for operational teams.

• Preferred: knowledge of machine learning fundamentals, fine-tuning, or model evaluation frameworks.

• Preferred: experience in AI cost management, including token usage, model selection, and caching strategies.

• Preferred: background in legal or financial services.

🏝️ Benefits

• Medical, dental, and vision insurance.

• 401(k) plan with company matching.

• Health Savings Account (HSA).

• Life insurance coverage.

• Disability insurance.

• Paid time off.

• Parental leave.