Manager, Speaking Test Development

This is a fully remote position, open to applicants in District of Columbia, +1 more state.

📋 Description

• Supervise the creation of Speaking test items and supplementary materials for the WIDA suite of large-scale English language proficiency assessments aimed at multilingual learners in grades 1–12.

• Manage a team responsible for writing, reviewing, revising, and selecting Speaking test items.

• Assess items for task design, linguistic complexity, grade-level suitability, accuracy, accessibility, scaffolding, fairness, sensitivity, and adherence to style guides.

• Provide constructive feedback to test developers and approve item content during critical stages of development.

• Create plans for test refreshment, including timelines, procedures, project outlines, and item specifications.

• Collaborate with managers, directors, client organizations, vendors, and partner organizations.

• Supervise training materials and support for external reviewers.

• Lead stakeholder reviews and address feedback regarding test items.

• Oversee casting, recording sessions, and quality monitoring for audio components of the Speaking test.

• Compose, review, and maintain reports, procedures, foundational documents, style guides, checklists, test plans, and framework documents.

• Coordinate quality assurance checks of field-test QTI packages and supplementary materials.

• Review and revise functional rules for field tests.

• Supervise the qualitative analysis of Speaking field-test responses and report the findings.

• Conduct pilot testing and cognitive lab interviews.

• Collaborate on materials for Speaking-test scoring, including rubrics, rater training, courses, and scoring guidance.

• Assist in selecting anchor and training responses; review score justifications, appeals, qualifications, recalibrations, and validity sets.

• Maintain test maps, forms, practice items, sample items, databases, and design plans.

• Establish team goals, monitor staff performance, mentor team members, and support hiring, retention, and performance evaluations.

⛳️ Requirements

• A bachelor’s degree from an accredited college or university in a relevant field, along with a minimum of five years of relevant experience, or a master’s degree in a relevant field with at least two years of relevant experience.

• Proven expertise in developing large-scale spoken English language proficiency assessments for K–12 multilingual learners.

• Experience in supervising the development of test items in high-stakes environments.

• Proven track record in managing complex assessment projects.

• In-depth knowledge of the spoken language needs of K–12 multilingual learners in U.S. educational settings.

• Experience teaching K–12 multilingual learners in U.S. classrooms.

• Capability to apply the English language development and K–12 education standards of multilingual learners to the development of language-proficiency test items.

• Proficiency in coordinating remote team members across multiple tasks while adhering to deadlines and quality control standards.

• Strong ability to provide constructive and clear feedback.

• Ability to comprehend complex test designs with numerous interconnected components.

• Capacity to work independently with minimal guidance or supervision.

• Proficiency in prioritizing tasks, meeting deadlines, and collaborating effectively within a fully remote team.

• Exceptional attention to detail.

• Adaptability in responding to feedback and shifting project priorities.

• Strong leadership and problem-solving skills.

• Outstanding writing, editing, and proofreading abilities in English.

• Familiarity with style guides, including the Chicago Manual of Style.

• Excellent organizational, planning, and time-management skills.

• Strong oral and interpersonal communication capabilities.

• Proficiency in a language other than English.

• At least intermediate proficiency in Microsoft Office and Smartsheet or similar work-management platforms.

• Must be eligible to work in a U.S. location; candidates residing in New York, New Jersey, Pennsylvania, Texas, California, or U.S. Territories are not eligible for this position.

• A resume and cover letter are required.

🏝️ Benefits

• Eligible for benefits.

• Flexible option to work in person at the D.C. office in a hoteling capacity or remotely (up to 100% remote).

• Occasional travel required (1–3 times per year).