Director, Free Response Rating Capability Analyst

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop and uphold the capability roadmap for FR rating operations, encompassing tools, workflows, reporting frameworks, and performance measurement systems that facilitate high-quality scoring at scale.

• Convert operational requirements and scoring insights into well-defined business specifications, system enhancements, reporting structures, and process optimizations.

• Collaborate with Technology and Product teams to design, test, and implement improvements to scoring platforms and data pipelines.

• Create scalable frameworks for assessing scoring effectiveness, including metrics for consistency, accuracy, throughput, and reader-level performance.

• Support the comprehensive AP Exam scoring workflow, which includes reader training, scoring operations, psychometric data collection, and operational reporting.

• Track scoring performance indicators during live AP Reading and facilitate swift operational adjustments through data-driven insights.

• Construct analytic models, dashboards, and reporting tools that deliver real-time and post-Reading insights into scoring performance.

• Implement standardized reporting and postmortem analysis procedures that foster continuous improvement throughout Reading cycles.

• Develop and maintain cross-functional RACI documentation pertaining to digital scoring platform deployment, configuration, and operational support.

⛳️ Requirements

• Proficiency in operational analytics, scoring operations, education systems, or related domains, with experience in large-scale operational environments.

• Strong analytical and systems-thinking abilities, with a proven capacity to translate data into operational enhancements and scalable solutions.

• Experience with large datasets and reporting tools, including Excel, SQL, BI tools, or similar technologies.

• Excellent project management and prioritization abilities, capable of managing competing priorities among multiple stakeholders.

• Outstanding written and verbal communication skills, with the capability to distill complex analyses into actionable insights.

• Experience in collaborating with cross-functional teams, including operations, technology, product, analytics, and research partners.

• Comfort in both strategic planning and hands-on execution environments.

• Preference for candidates with experience in assessment, scoring operations, educational measurement, or education data systems.

• Bachelor’s degree is required; an advanced degree is preferred.

• Willingness to travel 2–4 times per year to College Board offices or on behalf of College Board business.

🏝️ Benefits

• Annual bonuses and opportunities for merit-based raises and promotions

• A mission-driven workplace where your impact matters

• A team that invests in your development and success