Senior Director, AP Assessment Design and Insights

This is a fully remote position, open to applicants in United States.

📋 Description

• Oversee the implementation of the assessment systems roadmap strategy for the AP, collaborating closely with the Executive Director.

• Manage the annual execution and upkeep of the AP digital assessment inventory.

• Lead the design and architecture of the AP Assessment Design & Systems SharePoint environment.

• Represent assessment priorities, requirements, and dependencies in discussions regarding systems and the digital roadmap.

• Convert assessment systems data into actionable insights through visualizations, executive reporting, and presentations.

• Utilize assessment standards, interoperability protocols, accessibility requirements, and generative AI tools to enhance systems requirements.

• Create and maintain the assessment design intake framework for new and updated AP courses.

• Maintain the AP assessment design knowledge base, which encompasses principles, item design, form development, psychometrics, validity, fairness, and lifecycle resources.

• Collaborate with the Executive Director and Psychometrics on multi-year test form planning.

• Provide counsel to the Executive Director regarding assessment design priorities, risks, dependencies, and solutions.

• Encourage innovative item design and the adoption of emerging assessment practices.

• Lead the divisional AP Assessment Community of Practice.

• Coordinate with internal and external subject-matter experts and speakers.

• Organize and execute community sessions, event logistics, session materials, and resource archives.

⛳️ Requirements

• A minimum of 8 years of progressive leadership experience in assessment design, test development, or assessment systems.

• Extensive expertise in educational assessment design, including the creation, validation, and delivery of assessments at scale.

• Proficiency in psychometric, fairness, and design principles applicable to large-scale examinations.

• Proven experience in leading strategic initiatives across assessment design, systems, and knowledge management.

• Capability to translate intricate assessment and technical requirements into actionable guidance.

• Ability to facilitate cross-functional discussions and align stakeholders in product, technology, psychometrics, curriculum, and assessment.

• Strong analytical and communication skills, including the ability to provide executive-level insights, visualizations, and presentations.

• Familiarity with assessment design conventions and data structures, such as blueprints, test and form constraints, item pools, and scoring specifications.

• Knowledge of QTI, APIP, HTML, WCAG, and metadata schemas.

• Experience with JSON, Python or SAS, and accessibility frameworks is advantageous.

• High proficiency in SharePoint, Smartsheet, and PowerPoint.

• Proficient in Microsoft 365 applications.

• Familiarity with Productboard, Jira, and Confluence.

• A strong passion for enhancing educational and career opportunities through mission-driven work.

• A curious mindset and readiness to embrace AI-driven solutions.

• Excellent written and verbal communication skills.

• A learner's mindset and dedication to personal growth through feedback and collaboration.

• A commitment to making an impact and achieving excellence through data-informed decisions and ongoing improvement.

• A collaborative and empathetic working style.

• Authorization to work in the United States.

🏝️ Benefits

• Opportunity to work fully remotely or in a hybrid model for candidates residing near College Board offices (in-office on Tuesdays and Wednesdays).

• Occasional travel required for in-person business meetings.

• Comprehensive compensation and benefits package.

• Salary adjusted based on location.

• Supportive team environment and a fulfilling career at a self-sustaining nonprofit.