Senior Data Engineer, AI Platform

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop the data platform that supports analytics, machine learning, Generative AI, and Agentic AI for millions of customers and internal teams.

• Design, construct, and expand Zip’s enterprise Data & AI Platform.

• Create scalable data pipelines and architectures for both structured and unstructured data, accommodating batch and real-time workloads.

• Produce AI-ready data products, semantic models, and retrieval capabilities tailored for intelligent agents and AI-driven applications.

• Design and enhance capabilities for vector search, hybrid search, and Retrieval-Augmented Generation (RAG).

• Implement solutions driven by streaming and events for near real-time insights into business operations, intelligence, fraud detection, and risk management.

• Establish best engineering practices for data modeling, testing, observability, governance, security, and reliability of the platform.

• Promote self-service and automation initiatives to boost developer productivity and accelerate time-to-insight.

• Collaborate with teams in Data Science, Machine Learning, Product, Engineering, and business sectors.

• Guide engineers, influence architectural choices, and assist in defining the strategic direction of Zip’s data platform.

⛳️ Requirements

• Over 8 years of experience in designing, building, and managing enterprise-scale data platforms.

• Profound knowledge of modern cloud data platforms such as Snowflake, Databricks, Microsoft Fabric, BigQuery, Redshift, or comparable technologies.

• Advanced skills in SQL and Python, with extensive experience in data modeling, ELT/ETL development, dbt, and orchestration frameworks like Airflow, Dagster, or similar.

• Proven experience in constructing scalable streaming and event-driven architectures using technologies such as Kafka, Azure Event Hubs, Spark, or comparable platforms.

• Strong grasp of contemporary data architecture patterns, including dimensional modeling, semantic layers, data governance, metadata management, and platform observability.

• Experience in supporting AI and machine learning workloads through AI-ready data models, vector search, metadata enrichment, Retrieval-Augmented Generation (RAG), and knowledge retrieval systems.

• Familiarity with modern lakehouse technologies and open table formats such as Apache Iceberg, Delta Lake, or similar technologies.

• Practical experience with cloud platforms (Azure preferred; AWS or GCP are also acceptable).

• Strong engineering mindset with a background in testing, CI/CD, infrastructure automation, and operational excellence.

• Demonstrated ability to lead technical projects, mentor engineers, and effectively collaborate across technical and business teams.

• A strong sense of ownership and accountability for the accuracy, consistency, reliability, and quality of data.

• Visa sponsorship is not available for this position.

🏝️ Benefits

• Flexible working environment.

• Incentive programs.

• Unlimited Paid Time Off (PTO).

• Generous paid parental leave.

• Leading family support policies.

• Company-sponsored 401k match.

• Stipend for learning and wellness subscriptions.

• Beautiful office located in Union Square with a casual dress code.

• Industry-leading, employer-sponsored insurance for you and your dependents, featuring several 100% Zip-covered options.