Lead Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, develop, and manage ETL/ELT pipelines that integrate finance, HR, CRM, document management, and various enterprise systems.

• Establish and uphold data architecture standards, models, schemas, and storage patterns for cloud data warehouse and lakehouse platforms.

• Lead the implementation and operation of Microsoft Azure data services, which include Azure Data Factory, Azure Databricks, Azure Data Lake Storage, and Azure Synapse Analytics.

• Take ownership of enterprise data warehouse and lakehouse platforms, focusing on models, ingestion pipelines, performance, reliability, and operational health.

• Implement source control, branching strategies, CI/CD pipelines, automated testing, deployment workflows, as well as monitoring and alerting systems.

• Oversee the scheduling, execution, reconciliation, and monitoring of production data workflows.

• Identify and resolve failures in data pipelines, data quality issues, and performance bottlenecks.

• Collaborate with Information Governance and Security teams on data quality, lineage, reconciliation, stewardship, and source-of-truth ownership.

• Translate business needs into technical solutions and convey complex data concepts to non-technical stakeholders.

• Ensure that data solutions adhere to security policies, confidentiality requirements, and regulatory obligations.

• Assess emerging data, analytics, and AI capabilities and lead proof-of-concept initiatives.

• Provide design guidance, conduct code reviews, and offer technical mentorship to junior engineers or database professionals.

• Manage data-focused projects from inception to delivery while coordinating with internal teams and external vendors or consultants.

• Ensure knowledge transfer and the long-term sustainability of the delivered solutions.

⛳️ Requirements

• Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field, or equivalent practical experience.

• 8+ years of hands-on experience in data engineering, ETL/ELT development, and data integration.

• 3+ years of experience in designing and operating cloud-based data platforms, preferably on Microsoft Azure.

• Strong skills in MS SQL and experience with relational database design, development, and performance tuning, with SQL Server as a preference.

• Proven experience in building reliable production data pipelines, which include monitoring, alerting, and reconciliation mechanisms.

• Familiarity with source control and deployment practices for data workflows, including Git and CI/CD pipelines.

• Exceptional written and verbal communication skills, with the ability to explain technical concepts to non-technical audiences.

• Capability to handle sensitive and confidential information with discretion and professionalism.

• Availability for occasional after-hours work for major releases or production incidents.

• Advanced experience with Azure Data Lake Storage, Azure Databricks, Azure Data Factory, and Azure Synapse is preferred.

• Experience in implementing enterprise data warehouses, data marts, and lakehouse architectures is preferred.

• Familiarity with Azure Data Factory, Talend, Boomi, or similar data integration platforms is preferred.

• Strong scripting and programming skills in Python, PowerShell, and/or .NET/C# are preferred.

• Experience with Power BI or Tableau is preferred.

• Knowledge of data governance frameworks, data quality controls, data cataloging, and lineage documentation is preferred.

• Experience in a law firm or professional services environment is a plus.

• Relevant certifications, such as Microsoft Certified: Azure Data Engineer Associate, are a plus.

🏝️ Benefits

• Competitive compensation.

• Comprehensive benefits program.

• Opportunities to engage in enterprise-scale technology initiatives.

• Equal employment opportunities.

• Reasonable accommodations for qualified individuals with disabilities.