This is a fully remote position, open to applicants in Poland.

📋 Description

• Evaluate advanced language models focusing on Ukrainian grammar, syntax, morphology, spelling, phonology, pragmatics, and other related linguistic topics.

• Document instances where the model fails to enhance its reasoning capabilities.

• Engage in discussions with the model regarding various language scenarios.

• Assess the accuracy of facts and the soundness of logic.

• Record reproducible error traces for further analysis.

• Propose enhancements to prompt engineering and evaluation metrics.

⛳️ Requirements

• Proficiency in the Ukrainian language, encompassing grammar, syntax, morphology, spelling, phonology, and pragmatics.

• Capability to analyze verb conjugation, case systems, sentence structure, aspectual pairs, regional dialects, as well as formal and informal speech, along with the Ukrainian writing system.

• Skill in conversing with language models on various language scenarios.

• Competence in verifying the factual accuracy and logical consistency of information.

• Ability to capture reproducible error traces for documentation.

• Aptitude for suggesting improvements to prompt engineering and evaluation metrics.

• Strong metacognitive communication skills, including the ability to "show your work."

• A master’s or PhD in Ukrainian language, linguistics, or a related discipline is preferred.

• Evidence of peer-reviewed publications, teaching experience, or involvement in practical linguistic analysis projects indicates suitability.