Assessment Measurement Specialist

This is a fully remote position, open to applicants in United States.

📋 Description

• Offer psychometric expertise for K12 assessment programs and related initiatives.

• Assess and compare interim and growth assessment options, including vendor documentation, norms, scoring methodologies, growth measures, research evidence, and administration requirements.

• Evaluate the appropriateness of assessments for their intended purposes and provide recommendations for selection and renewal of assessments.

• Analyze interim assessment results to detect unusual score fluctuations, subgroup trends, conflicting evidence, or outcomes that necessitate further technical examination.

• Conduct focused reviews of flagged School Progress Meeting/Continuous Accountability Monitoring Plan results.

• Ascertain whether observed trends indicate substantial performance differences, measurement variations, administration challenges, data-quality issues, or assessment limitations.

• Assess reliability, validity, score distributions, measurement errors, subgroup patterns, and other indicators of assessment quality.

• Identify data or methodological constraints influencing conclusions and provide interpretive guidance.

• Evaluate cross-assessment comparability and advise on when results can be compared or integrated.

• Create technical documentation, guidance, and resources for consistent interpretation of assessment outcomes.

• Analyze relationships between interim and state assessments and assess their alignment with state proficiency and growth results.

• Examine student assessment growth outcomes and apply established methodologies to appraise vendor and state growth measures.

• Collaborate with Assessment, Accountability, Academics, Research, and Data teams.

• Clearly communicate technical findings to non-technical audiences.

• Stay updated on advancements in educational measurement, assessment validity and reliability, and K12 assessment practices.

• Recommend suitable applications to existing assessment practices.

• Perform additional duties as assigned.

⛳️ Requirements

• Master’s degree in Psychometrics, Educational Measurement, Quantitative Psychology, Applied/Educational Statistics, Research Methods, or a related field, or an equivalent combination of education and experience.

• A minimum of 8 years of experience in psychometrics, educational measurement, or assessment-related analytic work, including experience with K12 assessment programs.

• Proficiency in applying reliability analysis, measurement error evaluation, score distribution analysis, and subgroup performance analysis.

• Experience in analyzing and interpreting growth measures, including student growth percentiles, value-added, or vendor-specific growth models.

• Proficient in reviewing vendor technical documentation, norms, scoring methodologies, and reliability/validity evidence.

• Strong written and verbal communication skills with the ability to convey complex technical/statistical findings to non-technical audiences.

• Capacity to work independently and exercise sound technical judgment on ambiguous or sensitive data-quality issues.

• Desired: Ph.D. in a relevant field.

• Desired: Experience in supporting a school performance/accountability model or a similar system.

• Desired: Familiarity with prominent K12 interim and formative assessment vendors and their technical/psychometric documentation.

• Desired: Experience in evaluating cross-assessment comparability or conducting assessment triangulation studies.

• Desired: Experience in reviewing technical documentation and developing guidance or training resources.

• Desired: Proficiency with statistical/psychometric software such as R, SAS, Stata, WINSTEPS, flexMIRT, or similar tools.

• Desired: Familiarity with state assessment and accountability policies in a K12 context.

🏝️ Benefits

• Eligible employees may receive a bonus.

• Health benefits.

• Retirement contributions.

• Paid time off.

• Reasonable accommodations available for applicants with disabilities.