Product-Focused Data Scientist – LLM Products

This is a fully remote position, open to applicants in New York.

📋 Description

• Collaborate with political strategists to gain insights into their workflows and determine how AI can enhance their tasks.

• Convert strategist workflows into product decisions that involve both human input and AI agents.

• Set forth robust yet practical standards for the assessment of AI systems.

• Create evaluations and LLM-as-judge systems to verify the accuracy, foundation, and usefulness of LLM-powered features.

• Quickly prototype concepts using coding agents prior to making product commitments.

• Present findings and trade-offs to both technical and nontechnical audiences, including clients.

⛳️ Requirements

• Over 5 years of experience as a data scientist or applied statistician.

• Significant experience in delivering features or products.

• Proficient in Python, SQL, and standard statistical/ML tools.

• Comfortable working with real-world data.

• Practical experience in evaluating or building on top of LLMs.

• Experience in designing evaluation sets.

• Familiarity with constructing LLM-as-judge pipelines.

• Background in working with embeddings.

• Strong product instincts and a focus on end-user interaction with models.

• Excellent written and verbal communication skills with both technical and nontechnical stakeholders.

• Driven by Blue Rose Research’s mission and keen on understanding the progressive political landscape.

• Must possess legal authorization to work in the United States.

🏝️ Benefits

• Medical insurance.

• Dental insurance.

• Vision insurance.

• 401k matching.

• Unlimited paid time off (PTO).

• Remote-first work arrangement.

• Access to NYC office.