Senior Data Engineer – AI Native

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and oversee scalable data platforms that facilitate real-time analytics, batch processing, and exploratory analysis, employing AI-assisted development as the standard workflow rather than an afterthought.

• Own the entire data lifecycle: ingestion, ETL, storage, and serving, creating and iterating on pipelines with AI pair-programming tools (Claude Code) to accelerate the delivery process.

• Ingest data from a variety of sources through both streaming (Kafka, Kinesis) and batch pipelines, consolidating them into a unified, queryable platform.

• Architect medallion-layer data models (Bronze/Silver/Gold) within Databricks, ensuring that business requirements are fulfilled with clear, well-documented schemas.

• Automate, test, and fortify data workflows by writing AI-enhanced tests, implementing data quality checks, and establishing CI/CD pipelines that detect issues prior to production.

• Develop and maintain AI-ready tools: create prompts, custom slash commands, and agent workflows that enable the entire team to scaffold pipelines, generate documentation, and validate data quality more efficiently.

• Build and enhance Databricks Genie chatbots that enable non-technical users to query data using natural language.

• Collaborate with product analytics and data science teams, applying engineering principles to transform messy, unstructured data into reliable, production-ready datasets.

• Contribute to infrastructure-as-code (Terraform/Atmos) for the provisioning and management of cloud data infrastructure.

⛳️ Requirements

• 5+ years of experience working with high-volume data infrastructure.

• Core technology stack: Databricks, AWS (EMR, Kinesis/Kafka, S3), Apache Spark/Spark Streaming, Apache Airflow (MWAA), SQL, Python (Java/Scala is a plus).

• AI-native mindset: You utilize LLM-based development tools daily, viewing them as essential rather than merely novel. You are capable of assessing the accuracy of AI-generated code, refactoring prompts like code, and creating agentic workflows that enhance your team's productivity.

• Experience with data quality frameworks (Great Expectations, DQX, or similar): includes validation rules, schema enforcement, and automated monitoring.

• Established capability to design logical and physical data models, optimize SQL, and tune system performance.

• Familiarity with IaC tools (Terraform) for cloud infrastructure provisioning.

• Strong communicator who operates independently and delivers results with minimal oversight.

• Bachelor's degree in Computer Science, Engineering, Mathematics, or equivalent practical experience.

🏝️ Benefits

• Medical, dental, vision, life, and disability insurance plans fully covered for US employees.

• Supplemental medical and dental plans available for Canadian employees.

• 401(k) plan with company matching for US employees and RRSP with DPSP plan for Canadian employees.

• Employee Assistance Program (EAP) focusing on mental wellness.

• Flexible paid time off (PTO) and 12 company-wide days off throughout the year.

• Opportunities for learning and development.

• Provision of equipment, tools, and reimbursement support for a productive remote work environment.

• Complimentary Life360 Platinum Membership for your preferred circle.