Senior Cloud Data Architect – Databricks Lakehouse

This is a fully remote position, open to applicants in United States.

📋 Description

• Spearhead the design and implementation of the cloud data lakehouse architecture for the ingestion of federal species data.

• Architect Delta Live Tables ETL pipeline structures, encompassing pipeline topology, data flow patterns, transformation stages, and error-handling frameworks.

• Direct schema harmonization efforts, which include source-to-target gap analysis and detailed field-level mapping documentation.

• Establish metadata standards for ingested datasets, covering naming conventions, data types, null handling, and authoritative source attribution.

• Create the structure and population methodology for the Metadata and Authoritative Source Registry.

• Supervise the development and deployment of ETL pipelines, ensuring proper version control and peer review processes are in place.

• Design frameworks for data quality validation that address completeness, accuracy, consistency, and spatial integrity.

• Generate the Data Model Harmonization Report for government review and approval.

• Lead the operational transition of ETL architecture, documenting procedures for data refresh, monitoring, and maintenance.

• Provide expert guidance on cloud data architecture for FedRAMP-compliant production deployments.

• Assist in the integration of marine and anadromous species data into the existing FWS platform, aiming to create a cohesive ESA-listed species data experience.

⛳️ Requirements

• A Bachelor's degree with 12 years of professional experience, a Master's degree with 10 years of professional experience, an Associate's degree with 14 years of professional experience, or a high school diploma/equivalent with 16 years of professional experience.

• Must be a U.S. Citizen.

• Capability to obtain and maintain a Public Trust clearance.

• Extensive background in cloud data architecture, with proficiency in Databricks and Delta Lake/Delta Live Tables.

• Experience in designing data lakehouse architectures for large-scale data migration initiatives.

• Proven experience with schema harmonization, ETL pipeline design, and data quality frameworks.

• Strong understanding of FedRAMP, FISMA, and federal cloud compliance requirements.

• Experience in metadata management and the design of authoritative source registries.

• Databricks Certified Data Engineer or an equivalent certification is preferred.

• AWS Certified Solutions Architect or AWS Certified Data Engineer certification is preferred.

• Experience with federal environmental or geospatial data systems is preferred.

• Familiarity with spatial data integration and GIS data pipelines is preferred.

• Active Public Trust Clearance is preferred.

🏝️ Benefits

• Potential eligibility for overtime.

• Potential eligibility for shift differential.

• Potential eligibility for a discretionary bonus.