
Data Scientist Intern
Posted 3 days ago

Posted 3 days ago
This is a fully remote position, open to applicants in United States.
• Examine both structured and unstructured recruiting data, which includes resumes, candidate evaluations, interview feedback, and hiring funnel metrics.
• Create metrics and analytical frameworks that assess candidate quality, interview effectiveness, evaluation consistency, and recruitment efficiency.
• Investigate evaluation results generated by AI interviewers and large language models (LLMs) to pinpoint trends, failure modes, biases, and areas for enhancement.
• Design experiments to assess prompts, interview techniques, scoring systems, and AI evaluation models.
• Develop statistical or machine learning models to facilitate candidate-job matching, candidate ranking, interview outcome analysis, and recruitment funnel forecasting.
• Generate datasets and evaluation pipelines to measure the performance of LLM-driven recruiting systems.
• Conduct exploratory data analysis and present findings through dashboards, visualizations, and succinct analytical reports.
• Collaborate with product and engineering teams to transform analytical insights into enhancements for products.
• Assist in establishing data quality checks, experiment tracking, and reproducible analytical workflows.
• Investigate new applications of machine learning and generative AI in the realms of recruiting and talent intelligence.
• Analyze the relationships between interview responses, AI evaluation scores, recruiter choices, and hiring outcomes.
• Develop benchmarks and metrics to ensure the consistency and quality of AI-generated candidate assessments.
• Create or assess models for resume-job matching.
• Analyze interview questions and candidate replies to uncover valuable signals for candidate assessment.
• Identify bottlenecks and conversion patterns across different stages of the recruitment funnel.
• Examine scoring distributions to enhance evaluation consistency across various jobs and interview sessions.
• Conduct controlled experiments comparing prompts, models, evaluation rubrics, or interview strategies.
• Currently enrolled in or recently graduated from a degree program in Computer Science, Data Science, Statistics, Mathematics, Artificial Intelligence, Machine Learning, or a closely related technical field.
• Strong analytical thinking and problem-solving capabilities.
• Proficiency in Python and familiarity with common data analysis libraries such as Pandas and NumPy.
• Working knowledge of SQL and relational data analysis.
• Understanding of statistics, probability, experimental design, and data visualization techniques.
• Familiarity with machine learning concepts and typical ML workflows.
• Ability to clearly communicate analytical findings to both technical and non-technical team members.
• Comfortable operating in a fast-paced startup environment and independently navigating ambiguous challenges.
• Nice to have: Experience with machine learning libraries like scikit-learn, PyTorch, or TensorFlow.
• Nice to have: Experience with LLMs, prompt engineering, embeddings, retrieval-augmented generation (RAG), or AI agents.
• Nice to have: Knowledge of LLM evaluation methodologies, benchmarking, or human/AI evaluation processes.
• Nice to have: Experience analyzing text or other unstructured data using natural language processing (NLP) techniques.
• Nice to have: Experience with visualization tools or business intelligence (BI) software.
• Nice to have: Familiarity with A/B testing, causal inference, ranking systems, recommendation systems, or information retrieval techniques.
• Nice to have: Experience working with production datasets, data pipelines, or cloud computing platforms.
• Internship experience at a genuine AI SaaS product.
• Practical experience in assessing and enhancing production LLM and AI-agent systems.
• Experience in designing metrics and experiments for AI product development.
• Hands-on experience with real-world recruiting and interview datasets.
• Experience in translating analytical insights into product and engineering decisions.
• Experience in constructing data science workflows within an early-stage AI startup.
• Direct collaboration with founders and engineers on projects that impact production.
Commit
Counterpart
Oportun
Get handpicked remote jobs straight to your inbox weekly.