Director, Monitoring, Learning, and Evaluation – AI Access Initiative

This is a fully remote position, open to applicants in United States, +3 more countries.

📋 Description

• Develop 2AI's strategy for measurement and evaluation in Agriculture, Health, and the Incubator.

• Establish and uphold rigorous MLE standards from the design phase through to dissemination.

• Create standards for responding to weak or emerging evidence, uncertainty, and critical assumptions.

• Test and formulate industry-leading practices for AI-driven MLE methodologies.

• Investigate cutting-edge AI tools and techniques, such as LLM-assisted evidence synthesis and agentic analysis pipelines.

• Design the structure of the MLE team, recruit initial hires, and cultivate a high-achieving team.

• Set performance benchmarks and foster a culture centered on proactive feedback.

• Offer technical oversight and mentorship on complex issues.

• Counsel the Incubator on program evaluation and pilot design.

• Evaluate current evidence and rigorously test hypotheses.

• Identify gaps in evidence and create stage-appropriate learning frameworks.

• Evaluate outcome and cost-effectiveness models and critical assumptions.

• Develop measurement systems, protocols, and data collection methods for active Agriculture and Health initiatives.

• Facilitate rapid experimentation, including A/B testing of AI tool features and delivery methods.

• Pinpoint high-value portfolio questions and ensure that findings are communicated to program and country teams.

• Manage the MLE budget and resource allocation plan.

• Obtain buy-in and funding for the MLE function.

• Convey methods, outcomes, and insights to funders and partners.

• Publish MLE outputs as publicly accessible resources.

⛳️ Requirements

• Over 10 years of progressive experience in monitoring, learning, and evaluation, including hands-on leadership of a robust quantitative function that supports data-driven decisions in global health or development.

• An advanced degree in economics, statistics, public health, or a related quantitative field, or equivalent advanced training and technical experience; a PhD is optional.

• Proficiency in evaluation design and analysis, including statistically sound impact evaluations, process evaluations, and mixed-methods approaches.

• Experience managing large-scale quantitative evaluations from inception to dissemination.

• Ability to interpret existing evidence and convert it into informed program decisions.

• Proven track record in team building and nurturing senior technical talent, including establishing performance standards and providing clear, consistent feedback.

• Strong understanding of and experience with AI applications in the MLE process.

• Expertise in quantitative modeling under uncertainty, including outcome and cost-effectiveness estimates for early-stage initiatives.

• Comfort with ambiguity and experience in establishing new systems, structures, and standards where none previously existed.

• Capacity to make difficult choices among imperfect alternatives and communicate the associated trade-offs.

• Strong technical communication skills suitable for MLE specialists, funders, government counterparts, and non-technical audiences.

• Ability to cultivate relationships with program teams, partners, and peer organizations, along with an external presence through publications, conference presentations, or similar platforms.

• Applicants must be legally authorized to work in the country where they are located.

• Evidence Action cannot sponsor or take over sponsorship of an employment visa.

• Experience with R, Python, Stata, or similar analytical tools is advantageous.

• Field experience in low- and middle-income countries is desirable.

• Experience assisting government partners with data-driven decisions related to program implementation is a plus.

🏝️ Benefits

• Comprehensive benefits package.

• Health insurance.

• Vision insurance.

• Dental insurance.

• Retirement plans.

• Generous and flexible leave options.

• Additional employee perks.

• International travel (~15-20%).