AI Benchmark Engineer – Native Language Specialist, Hindi

This is a fully remote position, open to applicants in India.

📋 Description

• Assessing Coding Agents.

• Create realistic task scenarios utilizing datasets and files in your primary language.

• Identify failure points where AI underperforms, in your primary language.

• Assist in developing robust solutions and produce highly dependable verifier scripts.

• Examine execution logs and adjust task difficulty using standard run configurations.

• Engage in a comprehensive, human quality control process alongside automated evaluations.

⛳️ Requirements

• Over 5 years of professional experience in software engineering.

• Demonstrated success at leading technology firms and/or a degree from prestigious engineering institutions.

• Native or near-native fluency, with a thorough comprehension of its grammar, register, and phrasing rules. High proficiency in English.

• Strong expertise in Python, standard shell scripting, and data processing.

• Extensive experience with Terminal/CLI-based development workflows and familiarity with coding agents.

• In-depth technical knowledge of multilingual text processing challenges.

🏝️ Benefits

• Set your own schedule and work according to your preferences.

• Receive prompt and fair compensation.

• Contribute to projects that truly matter.

• Become part of a larger mission.

• Experience unlimited growth opportunities.

• Enjoy doing what you love.