Manager – AI & Data Platform Engineering

This is a fully remote position, open to applicants in California.

📋 Description

• Lead a team of data and AI engineers situated in the US and India, taking responsibility for performance, career development, and daily operations for both full-time staff and contractors.

• Oversee the Data Platform utilizing Snowflake, dbt, and Matillion.

• Establish enterprise knowledge and AI foundations by converting structured and unstructured data into reliable AI-ready resources like knowledge graphs and vector stores.

• Ensure the quality, reliability, and timely delivery of the platform.

• Transform platform strategy and architectural vision into actionable roadmaps, quarterly plans, and tangible results.

• Collaborate with architects and engineering leadership, adjusting focus across data, knowledge, and AI initiatives as priorities evolve.

• Manage the platform as a product for internal clients, defining service levels, onboarding processes, and streamlined pathways.

• Develop automated operations for pipeline monitoring, failure management, data quality assessments, and corrective actions.

• Create reusable operational frameworks and standards applicable to other teams.

⛳️ Requirements

• Practical knowledge of Generative AI architectures, especially RAG and enterprise knowledge systems, with experience in designing pipelines for both structured and unstructured data.

• Over 10 years of experience in software engineering, data engineering, data platform engineering, or data architecture.

• More than 3 years of experience in leading engineering teams, showcasing both technical and interpersonal leadership skills.

• Strong hands-on proficiency in Python and SQL, paired with a solid grounding in modern data engineering and distributed systems.

• Experience in designing and managing production-grade data platforms on AWS or another significant cloud platform using Snowflake, Databricks, or BigQuery, along with dbt.

• Strong foundation in data quality, metadata management, lineage, governance, and observability.

• Proven capability to convert ambiguous challenges into scalable engineering solutions.

• Production experience in creating RAG or GraphRAG platforms, knowledge graphs, graph databases, vector databases, embeddings, hybrid retrieval, and re-ranking.

• Practical experience in building infrastructure for AI agents and agentic workflows using LangGraph, LangChain, or LlamaIndex, in conjunction with LLM evaluation, AI observability, and LLMOps.

• Extensive cloud-native platform engineering expertise encompassing Kubernetes, Terraform, and Ray/Ray Data.

• A successful history of developing internal developer platforms and reusable data and AI platform services.

🏝️ Benefits

• Various health plans.

• Time off plans for vacation and sick leave.

• Options for parental leave.

• Retirement plans.

• Education reimbursement.

• In-office perks.

• Comprehensive and inclusive benefits for employees and their families.

• Reasonable support/accommodations during the recruitment process.