AI Technology Risk Manager

This is a fully remote position, open to applicants in United States.

📋 Description

• Conduct model risk evaluations and validation tasks for machine learning, generative AI, large language models, agentic AI, and other sophisticated analytical models throughout their lifecycle.

• Carry out independent assessments and critiques of AI and machine learning models.

• Evaluate the conceptual integrity and suitability of development, testing, validation, and monitoring processes.

• Identify AI-specific risks, including performance, reliability, bias, fairness, explainability, robustness, data quality, hallucination, drift, misuse, and human oversight.

• Create, review, and manage model documentation and validation reports.

• Oversee the enterprise model inventory and maintain model lifecycle records.

• Monitor validation results, limitations, remediation efforts, exceptions, and other model risk factors.

• Assist in model performance monitoring and periodic review processes.

• Develop and sustain model risk metrics, key risk indicators, inventory reporting, validation status reporting, and issue tracking.

• Prepare model risk evaluations, validation reports, conclusions, and recommendations for stakeholders and governance committees.

• Improve AI model risk management policies, standards, procedures, methodologies, templates, controls, and governance processes.

• Collaborate with data science, engineering, product, business, technology risk, and enterprise risk teams.

• Evaluate third-party AI models, foundational models, platforms, and model-related services.

• Keep abreast of regulatory guidance, supervisory expectations, industry standards, and best practices regarding model risk and AI governance.

• Exercise independent judgment and communicate significant findings to the Senior Manager and risk stakeholders.

• Provide recommendations related to model exceptions, risk acceptances, and remediation strategies.

⛳️ Requirements

• A Bachelor's degree in Data Science, Computer Science, Statistics, Mathematics, Engineering, Information Systems, Risk Management, or a related discipline.

• At least 7 years of experience in model risk management, model validation, AI/ML risk, quantitative risk, data science, technology risk, or a similar field.

• Practical experience in conducting model risk assessments, model validation, or independent reviews and challenges of machine learning, generative AI, or advanced analytical models.

• Experience in evaluating model methodologies, assumptions, data, performance metrics, testing strategies, limitations, and ongoing monitoring.

• Strong knowledge of machine learning and AI technologies, including large language models, foundational models, generative AI, model training and evaluation, retrieval-augmented generation, and agentic AI.

• Familiarity with model lifecycle governance, encompassing model identification, risk classification, validation, inventory management, implementation, monitoring, change management, and retirement.

• Experience in developing, reviewing, or maintaining model documentation and model inventory information.

• Understanding of model risk management principles, responsible AI practices, data governance, and AI governance frameworks.

• Knowledge of accuracy, stability, robustness, benchmarking, back-testing, sensitivity analysis, bias and fairness testing, drift monitoring, and model limitations.

• Capability to independently assess and challenge complex quantitative and technical concepts using sound risk judgment.

• Excellent written and verbal communication skills.

• Strong analytical abilities, attention to detail, and capability to manage multiple reviews and governance activities concurrently.

• Ability to work collaboratively across data science, engineering, technology, risk, compliance, and business teams.

• Must be authorized to work for any employer in the U.S.; no employment visa sponsorship, including CPT/OPT.

• Reliable high-speed internet with a wired connection and a suitable home workspace.

🏝️ Benefits

• Medical, dental, vision, and life insurance.

• 401(k) plan with generous company matching contributions up to 6%.

• Financial advisory services.

• Potential company discretionary retirement contributions.

• Extensive investment options.

• Tuition reimbursement up to $5,250 per year.

• Business-casual environment with the option to wear jeans.

• Paid time off program.

• Ten paid company holidays and three floating holidays each calendar year.

• Paid volunteer time — 16 hours per calendar year.

• Paid parental leave.

• Paid short- and long-term disability.

• Family and Medical Leave (FMLA).

• Business Resource Groups open to all.

• Flexible hours.

• Reliable high-speed internet and necessary computer equipment provided for remote and hybrid positions.