Lead Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Establish the technical strategy for migrating data and pipelines to the lakehouse.

• Provide guidance to migration teams on methodologies, reconciliation processes, and quality checkpoints.

• Create reusable migration pipelines utilizing Azure Data Factory and Azure Databricks.

• Define methods for source and target data reconciliation to ensure precision.

• Address complex pipeline and performance challenges.

• Mentor data engineers and evaluate their contributions.

• Collaborate with product, QA, and platform teams.

• Carry out other related responsibilities as assigned.

⛳️ Requirements

• Proven leadership in data engineering for significant migration or modernization initiatives.

• Extensive experience with Databricks or Spark and Azure Data Factory.

• Proficient in SQL and Python.

• Background in transitioning legacy ETL and data warehouse operations to the cloud.

• Familiarity with lakehouse and medallion architecture, including Delta.

• Experience in federal or regulated data environments is advantageous.

• Capability to excel in a remote, collaborative Agile setting.

• Strong interest and ability in leading and mentoring engineers.

• Excellent communication skills, both clear and open.

• Candidates must be authorized to work in the United States.

• Certain positions may necessitate U.S. citizenship and the ability to secure and maintain a federal background check and/or security clearance.

• Bachelor’s Degree is required.

🏝️ Benefits

• Fully remote work environment.

• Technology & Education Stipend.

• Comprehensive benefits package.

• Company-matched 401(k) plan.

• Flexible Paid Time Off (PTO).

• Paid holidays.