Senior Data Engineer – Analytics Lead

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop essential components for three data products serving a federal agency.

• Integrate partner contributions and perform technical evaluations prior to acceptance.

• Take ownership of data quality, providing documented deduplication, reconciliation, and quality controls.

• Construct reliable ingestion and transformation pipelines across legacy systems, current systems of record, and various contractor data formats.

• Generate traceable source-to-target mappings.

• Create Data Vault 2.0 and Gold tier models to support necessary analytics and independent querying by agency analysts.

• Develop integrated semantic models and provide support for Microsoft Power BI.

• Enhance performance and produce production-ready code.

• Produce data dictionaries, pipeline specifications, runbooks, and materials for knowledge transfer.

• Assist in ensuring that products are comprehensible and maintainable following cutover.

• Collaborate with developers, engineers, data scientists, architects, strategists, and machine learning engineers.

• Contribute to the development of the firm's capabilities, tools, and business lines.

⛳️ Requirements

• Over 8 years of experience in data engineering or analytics engineering, including a minimum of three years with Azure Databricks or a similar lakehouse platform.

• Proficient in Advanced Structured Query Language (SQL) and Python or PySpark.

• Familiarity with Delta Lake, ETL, ELT, orchestration, schema design, data quality, and performance optimization.

• Practical experience with Data Vault 2.0, dimensional modeling, semantic models, and production analytics.

• Working knowledge of Unity Catalog, source control, automated deployment, environment promotion, and CI/CD practices.

• Capability to support Microsoft Power BI datasets and dashboards.

• Competence in collaborating with machine learning engineers on feature pipelines and model deployment.

• Strong technical writing skills, with the ability to maintain diagrams, mappings, specifications, and runbooks.

• U.S. citizenship is required.

• Dual citizenship and green card holders are excluded by contract terms.

• Must meet necessary suitability, security, and access requirements.

• Preferred: Experience with a federal system accredited at Impact Level 5 (IL-5) or higher.

• Preferred: Databricks Data Engineer, Azure Data Engineer, or relevant cloud certification.

• Preferred: Knowledge of ServiceNow data, federal audit data, government financial data, or controlled federal environments.

• Preferred: Experience in transitioning solutions between Azure environments using infrastructure as code and Databricks Asset Bundles.

🏝️ Benefits

• Comprehensive medical, dental, and vision coverage with the employee premium fully covered and half of dependent premiums paid.

• Employer-sponsored life insurance, accidental death insurance, and both short-term and long-term disability insurance.

• 401(k) plan with 100% matching up to 4% of salary, with immediate vesting.

• Unlimited paid time off.

• Sponsored professional certifications and ongoing education opportunities.

• Extensive onboarding process.

• Opportunities for cross-functional rotation to enhance skills and broaden perspectives.