Lead Data Engineer

This is a fully remote position, open to applicants in Minnesota.

📋 Description

• Oversee the design and development of scalable, secure data pipelines that support AI/ML workloads.

• Take ownership of the complete data engineering lifecycle: ingestion, transformation, storage, quality assurance, and monitoring.

• Work collaboratively with data scientists and ML engineers on model features, training pipelines, and deployment strategies.

• Promote best practices in data modeling, orchestration, versioning, and performance enhancement.

• Mentor and support junior engineers; assist in developing technical roadmaps and solution patterns.

• Ensure compliance with data governance, lineage, and standards across various platforms.

• Support both real-time and batch processing frameworks within production environments.

• Adhere to corporate policies, procedures, and security protocols.

• Foster a robust Environmental Health and Safety culture by following safety guidelines, identifying risks, and participating in ongoing improvements.

⛳️ Requirements

• A bachelor's degree or higher in computer science (must be completed and verified before starting).

• Seven (7) years of experience in data engineering, including leading technical initiatives in private, public, government, or military settings.

• Proficient in Python, SQL, and distributed data systems (e.g., Spark, Databricks, Synapse).

• Experience in building AI/ML-ready data pipelines, including feature stores and model training data flows.

• Practical experience with cloud platforms (Azure preferred — Data Lake, Data Factory, Databricks, Cosmos DB).

• Strong understanding of ML concepts, lifecycle, and MLOps practices.

• Demonstrated experience with workflow orchestration tools (Airflow, Data Factory, Synapse Pipelines, etc.).

• Excellent communication skills and the ability to convert business requirements into technical solutions.

• Experience with streaming platforms (Kafka, Event Hub).

• Familiarity with vector databases, embeddings, or data pipelines oriented towards LLM.

• Background in DevOps, CI/CD, or infrastructure as code.

• Experience designing data solutions for AI applications or intelligent platforms.

• Must be legally authorized to work in the country of employment without sponsorship for employment visa status (e.g., H1B status).

• Educational background and work history must be included in the application.

🏝️ Benefits

• Medical, Dental & Vision coverage.

• Health Savings Accounts.

• Flexible Spending Accounts for Health Care & Dependent Care.

• Disability Benefits.

• Life Insurance.

• Voluntary Benefits.

• Paid Absences.

• Retirement Benefits.

• Up to 5% primarily domestic travel.

• Remote work arrangement.