Psychometrician

This is a fully remote position, open to applicants in District of Columbia, +1 more state.

📋 Description

• Design and execute psychometric analyses for the WIDA ACCESS program.

• Plan, implement, document, and present psychometric and statistical analyses utilizing classical test theory and the Rasch model.

• Evaluate item quality, rater performance, differential item functioning (DIF), reliability, classification consistency, standard setting, equating, scoring, and reporting.

• Explore and assess innovative methodologies for psychometric analyses in language testing.

• Establish and oversee quality control processes from data cleaning to final technical reporting.

• Offer quantitative insights to professional researchers regarding proposal design and analytical methodologies.

• Contribute to writing the quantitatively focused sections of proposals.

• Facilitate outreach and collaboration with external partners, academic institutions, educational and language innovators, as well as the general public.

• Manage external quantitative resources on behalf of the organization.

• Compose narratives that accompany psychometric analyses for technical reports and documentation.

• Develop replicable procedures for routine psychometric tasks.

• Mentor junior team members in statistical software applications.

⛳️ Requirements

• Ph.D. in Educational Measurement, Psychometrics, or a closely related field.

• At least five years of proven operational experience in designing and executing statistical and psychometric analyses for high-stakes testing programs.

• Significant experience applying the Rasch model to diverse psychometric challenges.

• Background in analyzing performance and polytomously scored tasks.

• Demonstrated proficiency in programming with R or Python.

• Skilled in using SPSS, Winsteps, Facets, and other statistical and psychometric software tools.

• Experience in a psychometric program within a K-12 U.S. educational context, ideally related to language testing.

• Proven ability to communicate effectively in English with clients as well as internal and external stakeholders in high-stakes environments.

• Track record of delivering timely, error-free outputs as part of a collaborative team.

• Capability to create and implement quality control procedures for databases, statistical and psychometric analyses, quantitative research, and technical documentation.

• Competence in programming, documenting procedures, and mentoring junior team members in R, Python, SPSS, Winsteps, Stata, and SAS.

• Ability to generate replicable procedures for routine psychometric processes.

• Skill in writing narratives accompanying psychometric analyses for technical reports and documentation.

• Capacity to collaborate with a diverse, multidisciplinary team of researchers and language testers.

• Strong background in computerized adaptive assessments.

• Experience in conducting standard-setting and/or alignment studies.

• Willingness to travel occasionally, 1–3 times per year.

• This position is not available to candidates residing in New York, New Jersey, Pennsylvania, Texas, California, or U.S. Territories.

🏝️ Benefits

• Eligible for benefits.

• Remote work available up to 100%.

• Preferred arrangement includes a combination of in-person work at the D.C. office in a hoteling capacity or remote work.

• Occasional travel required (1–3 times per year).