Forward Deployed Engineer

This is a fully remote position, open to applicants in New Zealand.

📋 Description

• Design, construct, and deploy enterprise-level AI solutions, encompassing advanced AI agents.

• Take ownership of workstreams from initial prototype through to production.

• Address intricate business challenges faced by customers.

• Establish quality metrics, evaluation frameworks, and essential datasets.

• Execute systematic evaluation cycles to enhance agent quality and identify regressions.

• Develop, refine, and deliver high-quality code and pipelines utilizing Python and SQL.

• Implement, oversee, and optimize AI solutions in secure, large-scale production settings.

• Create safety guardrails, observability mechanisms, and human-review processes.

• Leverage production traces and user insights to enhance evaluations.

• Collaborate directly with customer data science and engineering teams as a technical consultant and advisor.

• Partner with Snowflake Product and Engineering teams to provide field feedback.

• Dedicate at least 25% of time working onsite with strategic customers.

⛳️ Requirements

• Bachelor's degree in Computer Science, Engineering, a related technical field, or equivalent hands-on experience.

• Over 3 years of professional experience in software engineering.

• Willingness to travel.

• Demonstrated experience in developing applications utilizing LLMs, particularly RAG and agentic workflows.

• Practical experience in defining quality metrics and conducting evaluations for LLM or agent systems.

• Strong problem-solving abilities and communication skills.

• Capability to explain complex technical concepts to various stakeholders.

• Comfort in ambiguous and rapidly evolving Generative AI environments.

• Preferred: experience in creating evaluation sets from production traces and synthetic data.

• Preferred: familiarity with structured experimentation methods such as A/B testing, ablations, and offline evaluations.

• Preferred: knowledge of evaluation and observability tools like Braintrust, LangSmith, Arize, Weave, and Promptfoo, or custom evaluation harnesses.

• Preferred: experience in failure-mode analysis for agent or RAG systems.

• Preferred: hands-on experience in the MLOps lifecycle, including model deployment, monitoring, and evaluation on AWS, Azure, or GCP.

• Preferred: familiarity with pandas, numpy, and Snowpark.

• Preferred: experience in customer-facing technical roles.

• Preferred: experience in startup environments.

🏝️ Benefits

• Opportunity to engage with innovative AI technology.

• Chance to build production-grade AI systems utilizing Snowpark, Cortex, and native LLM functionalities.

• Opportunity to collaborate with strategic customers and shape Snowflake's AI platform.

• Possibility to travel and spend a minimum of 25% of time onsite with customers.