Lead Specialist, Measurement

This is a fully remote position, open to applicants in Texas.

📋 Description

• Oversee and facilitate the design and ongoing enhancement of AI-assisted assessment item development workflows that are integrated within broader assessment and learning systems.

• Convert Subject Matter Expert (SME) and measurement intent into structured, reusable AI-assisted workflows and frameworks that enable scalable, consistent, and auditable content creation and improvement.

• Employ AI-assisted tools and rapid prototyping methodologies to investigate, evaluate, and refine innovative assessment, content, learning, and instructional workflows.

• Provide support for assessment and learning materials across Mathematics, English Language Arts, Science, Social Studies, K–12 grade levels, TEIs, oral and constructed-response interactions, translation and multilingual content, ensuring alignment with academic content standards.

• Assist with fact-checking, grammar and style enhancement, distractor rationale improvement, and key validation processes.

• Guarantee that AI-assisted outputs fulfill expectations for validity, accuracy, fairness, accessibility, and instructional suitability.

• Lead and assist in validation strategies for AI-assisted learning and assessment applications beyond fundamental assessment item development workflows, including the generation and evaluation of academically similar items and student practice learning opportunities.

⛳️ Requirements

• An advanced degree in Educational Measurement, Psychometrics, Learning Sciences, Educational Technology, Artificial Intelligence, Educational Data Mining, Learning Analytics, Cognitive Science, Computer Science, Statistics, or a related discipline.

• Proven experience in assessment item development, learning systems, or educational content workflows.

• Experience collaborating in cross-functional environments, including teams focused on content, measurement, technology, product, or AI-related initiatives.

• A strong grasp of assessment quality principles, including validity, alignment, fairness, accessibility, and instructional suitability.

• Capability to think systematically about AI-assisted workflows related to content generation, scoring, feedback, instructional guidance, and learner experiences.

• Ability to assess where AI-assisted strategies can effectively enhance assessment and learning workflows, as well as where human expertise remains indispensable.

• Excellent analytical and problem-solving abilities, with a keen focus on quality, defensibility, and continuous improvement.

• Proficiency in designing or supporting robust validation and monitoring strategies for AI-assisted systems and workflows.

• Comfort in exploring, testing, and prototyping AI-assisted methodologies using cutting-edge tools and technologies.

• Strong written and verbal communication skills, with the ability to convey complex AI and measurement concepts to diverse audiences.

🏝️ Benefits

• This position is eligible for participation in an annual incentive program.

• Information on benefits offered is available here.