Senior Software Engineer, AI Governance

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, develop, and oversee the guardrail framework within Natera's LLM Gateway, focusing on content filtering, output validation, PHI/PII detection, prompt injection defenses, session retention, and audit logging.

• Create governance controls for agentic runtime and RAG infrastructure, which includes policy enforcement hooks, risk-based output routing, retrieval filtering, citation integrity checks, and measures to prevent PHI exposure.

• Implement platform controls with observability for filtering, flagging, escalation, and monitoring risk-profile drift.

• Ensure that AI platform controls comply with HIPAA, RAQA, and Natera's data classification requirements during the design phase.

• Design and establish an automated process for AI risk intake, scoring, tiering, and review-path routing that aligns with NIST AI RMF, CHAI, and the EU AI Act.

• Create and uphold an auditable AI Risk Register.

• Develop monitoring systems for production AI use cases, including accuracy tracking, drift detection, misuse alerting, and escalation thresholds.

• Build and maintain AI incident response tools for detection, alert routing, decision logging, and tracking remediation efforts.

• Manage AI use-case intake and assess new use cases based on the risk-tiering model.

• Conduct reviews of high-risk use cases with the AI Governance Board, providing recommendations and controls.

• Maintain risk questionnaires, scoring rubrics, and tiering criteria.

• Conduct technical due diligence for AI vendors and foundation model providers.

• Manage vendor AI risk assessment frameworks and contractual controls specific to AI.

• Assist in drafting and maintaining Natera's AI acceptable-use policy.

• Counsel teams on practical engineering requirements for AI governance.

• Report directly to the Head of AI & Data Governance and collaborate with platform engineering, Legal, Privacy, RAQA, and business teams.

⛳️ Requirements

• A minimum of 7 years of software engineering experience, with at least 3 years dedicated to AI/ML systems, LLM infrastructure, or AI safety and governance engineering.

• Demonstrable experience in building production AI systems, including LLM pipelines, RAG architectures, agentic runtimes, or AI observability and monitoring infrastructure.

• Solid understanding of production LLM risks such as hallucination, bias, prompt injection, data leakage, and model drift, along with experience implementing technical mitigations.

• Proficient in Python with experience in developing API-level integrations, middleware, and production data pipelines.

• Familiarity with ML observability and monitoring, including model instrumentation, drift thresholds, and alerting mechanisms.

• Experience in a regulated environment such as healthcare, life sciences, or financial services, with compliance responsibilities under HIPAA or similar regulations, and hands-on experience with PHI/PII data.

• Knowledge of the NIST AI Risk Management Framework (AI RMF 1.0) or ISO 42001, applied through control implementation.

• Capability to write technical specifications and documentation for engineers and Legal teams.

• Preferred: Experience with LLM gateway architectures, RAG pipeline controls, content moderation systems, or agentic AI safety infrastructure.

• Preferred: Skills in AI red-teaming, adversarial testing, or structured model evaluation.

• Preferred: Experience with trust and safety infrastructure or ML monitoring platforms such as Arize, Fiddler, Whylogs, or similar tools.

• Preferred: Background in diagnostics, genomics, or clinical AI.

• Preferred: Experience with HIPAA, FDA GxP, CLIA, PMDA, or GDPR-compliant systems.

• Preferred: Possession of CIPP, CIPT, or other recognized Responsible AI certifications.

🏝️ Benefits

• Comprehensive medical, dental, vision, life, and disability plans for eligible employees and their dependents.

• Complimentary testing for employees and their immediate families.

• Fertility care benefits.

• Leave for pregnancy and bonding with a new baby.

• 401(k) benefits.

• Commuter benefits.

• Employee referral program.