Solutions Architect, Lakehouse

This is a fully remote position, open to applicants in Virginia.

📋 Description

• Create lakehouse components on Azure Databricks, incorporating medallion layers from raw data ingestion to curated, business-ready tables along with the underlying Delta Lake storage.

• Develop and enhance the agency's Unity Catalog governance framework, which includes catalogs, schemas, access controls, lineage, and necessary data classifications.

• Construct data models utilizing dimensional modeling for reporting purposes and Data Vault where historical accuracy and auditability are critical.

• Link the lakehouse to external data sources via Lakehouse Federation and provide access to analysts through Databricks SQL and Power BI.

• Document design choices and reference models for the components managed.

• Evaluate implementations against the documented design choices and reference models.

• Clearly articulate architecture trade-offs and establish reusable patterns for the team.

• Assist in advancing the firm's capabilities, tools, and business lines.

• Leverage AI tools to implement, test, and enhance owned components while reviewing and validating their outputs.

• Work collaboratively with developers, engineers, data scientists, architects, and strategists across various assignments and client projects.

⛳️ Requirements

• Minimum of 4 years of experience in data architecture, data engineering, or analytics engineering, with a focus on design work within a production data platform.

• Bachelor's degree is required.

• Proficient hands-on experience with Azure Databricks, including Delta Lake and the medallion architecture.

• Knowledge of data governance within Unity Catalog, covering access control, lineage, and data classification.

• Experience in data modeling for analytics, specifically dimensional modeling; familiarity with Data Vault is an advantage.

• Advanced SQL skills and working knowledge of Python, including PySpark.

• Experience serving data to analysts and reporting tools, such as Databricks SQL and Power BI.

• Ability to produce decision records, standards, and diagrams that guide engineers and reviewers.

• Experience delivering in a federal government environment while adhering to its security, access, and review processes.

• Strong skills in writing, PowerPoint, and Excel.

• Must be a United States citizen; dual citizenship and green card holders are not eligible under contract terms.

• Capability to meet the necessary suitability, security, and access requirements.

• Preferred: Experience with a federal system accredited at Impact Level 5 (IL-5) or higher.

• Preferred: Data architecture experience in Microsoft Azure along with at least one other cloud platform, such as AWS or Google Cloud.

• Preferred: Familiarity with Lakehouse Federation, Databricks SQL warehouses, or Azure Data Factory.

• Preferred: Databricks certification or a Microsoft Azure architecture or data certification.

• Preferred: Experience in federal data governance, including records management, privacy, and security controls.

• Preferred: Knowledge of AI-assisted developer tools.

🏝️ Benefits

• Comprehensive medical, dental, and vision coverage with full payment of employee premiums and partial payment for dependent premiums.

• Employer-funded life insurance, accidental death coverage, and short-term as well as long-term disability insurance.

• 401(k) plan with an employer match of up to 4% of the salary.

• Unlimited paid time off.

• Sponsored professional certifications and opportunities for continuing education.

• Extensive onboarding process.

• Opportunities for rotation across functions to enhance skills and broaden perspectives.