Manager, Speaking Test Development

This is a fully remote position, open to applicants in District of Columbia, +1 more state.

📋 Description

• Supervise the creation of Speaking test items and supplementary materials for the WIDA suite of English language proficiency assessments for grades 1–12.

• Manage a team responsible for writing, reviewing, revising, and selecting Speaking test items.

• Assess items for task design, linguistic complexity, grade-level suitability, correctness, accessibility, scaffolding, fairness, sensitivity, and adherence to style guides.

• Provide constructive feedback to test developers and approve content during key stages of development.

• Formulate plans for test refreshment, project timelines, procedures, and item specifications.

• Collaborate with managers, directors, clients, vendors, partner organizations, and external reviewers.

• Lead stakeholder reviews and address feedback regarding content, fairness, and grade suitability.

• Oversee actor casting, recording sessions, and quality monitoring for Speaking test audio.

• Write, review, and edit reports, procedures, foundational documents, style guides, and checklists.

• Ensure adherence to quality control and test security procedures.

• Coordinate and approve quality checks for field-test QTI packages and supplementary materials.

• Supervise the qualitative analysis of responses from Speaking field tests and report the findings.

• Conduct pilot testing and cognitive lab interviews.

• Collaborate on Speaking scoring materials, rubrics, rater training content, and scoring guidance.

• Assist in the selection of anchor and training responses and review score justifications, appeals, and validity sets.

• Maintain test and item design plans, test frameworks, databases, and associated materials.

• Establish team goals, monitor staff performance, mentor employees, and manage hiring, retention, and performance reviews.

⛳️ Requirements

• Bachelor's degree from an accredited institution in a relevant field with a minimum of five years of pertinent experience, or a Master's degree in a relevant field with at least two years of relevant experience.

• Proficiency in developing large-scale spoken English language proficiency assessments for K–12 multilingual learners.

• Background in supervising test item development within a high-stakes environment.

• Experience in managing intricate assessment projects.

• In-depth understanding of the spoken language skills K–12 multilingual learners require to succeed in U.S. school settings.

• Teaching experience with K–12 multilingual learners in U.S. educational contexts.

• Ability to utilize knowledge of multilingual learners' English language development and K–12 education standards in the creation of language proficiency test items.

• Capability to coordinate remote staff across various tasks while adhering to deadlines and quality control standards.

• Skill in providing constructive and clear feedback.

• Comprehension of complex test designs consisting of multiple interrelated components.

• Ability to work autonomously with minimal supervision.

• Capability to prioritize tasks, meet deadlines, and collaborate effectively in a fully remote team.

• Strong attention to detail.

• Adaptability in responding to feedback and shifting project priorities.

• Leadership qualities along with analytical and creative problem-solving skills.

• Exceptional writing, editing, and proofreading skills in English.

• Familiarity with style guides, including the Chicago Manual of Style.

• Excellent organizational, planning, and time management abilities.

• Strong oral and interpersonal communication skills.

• Proficiency in a language other than English is a plus.

• At least intermediate proficiency with Microsoft Office and Smartsheet or similar work management platforms.

🏝️ Benefits

• Eligible for benefits.

• Option to work in person at the D.C. office in a hoteling capacity or remotely up to 100%.

• Occasional travel required (1–3 times per year).