Senior SWE – Python, TypeScript

This is a fully remote position, open to applicants in United States, +1 more country.

📋 Description

• Create, enhance, and iterate on rubrics, evaluation frameworks, and quality standards for preference data.

• Evaluate, analyze, and categorize data while detecting subtle inconsistencies, quality challenges, and areas for enhancement.

• Develop, sustain, and improve pipelines and infrastructure that facilitate data generation, collection, processing, and evaluation workflows.

• Consolidate insights from data analysis and evaluation efforts into succinct reports, updates, recommendations, and actionable summaries.

• Work closely with researchers and engineers to convert qualitative assessments into structured, repeatable, and scalable processes.

• Comprehend, contribute to, and manage intricate software repositories while ensuring high standards of code quality, reliability, and performance.

• Recognize workflow inefficiencies and apply practical enhancements to data quality, evaluation consistency, and engineering procedures.

• Successfully complete application screening, an AI-driven interview, a coding test, a technical and cultural interview, and final candidate assessment.

⛳️ Requirements

• A minimum of 5 years of professional software engineering experience with Python, especially in developing and maintaining pipelines and infrastructure, or with TypeScript, JavaScript, or Go.

• Direct experience with preference data collection, rubric development, or establishing evaluation criteria.

• Solid grasp of software engineering principles, code quality, debugging, and sustainable system design.

• Outstanding written and verbal communication skills, capable of articulating complex technical concepts clearly and succinctly.

• Strong analytical abilities and the capacity to make consistent, well-informed quality assessments.

• Proven ability to clarify why a specific solution, example, or implementation adheres to a high quality standard.

• Comfortable working autonomously in ambiguous settings while prioritizing execution and timely results.

• Experience contributing to or navigating large-scale, intricate open-source codebases, such as VS Code (preferred).

• Background in constructing data pipelines, developer infrastructure, or automated evaluation systems (preferred).

• Experience in AI model evaluation, preference data workflows, data annotation, or quality assessment (preferred).

• History of collaborating with AI researchers, machine learning engineers, or cross-functional technical teams (preferred).

• Education from a prestigious university or professional experience at a well-regarded technology firm (preferred).

• A LinkedIn profile is required and must be included in the candidate's resume.

• Must not currently be employed by Microsoft.

• Must be able to commit to the necessary weekly hours and PST overlap for the entire contract duration.

🏝️ Benefits

• Competitive salary and compensation package.

• Opportunity to work with a talented and diverse team.

• Access to professional development and training resources.

• Flexible working environment.