Senior Data Engineer – Databricks, Security & Governance

This is a fully remote position, open to applicants in United States.

📋 Description

• Oversee the development and execution of a unified data schema for federal species information within a cloud data lakehouse.

• Generate comprehensive source-to-target mapping documentation at the field level, detailing transformation logic, data type conversions, null handling, and data lineage.

• Establish and uphold metadata standards for all ingested datasets.

• Create and implement automated frameworks for data quality validation within ETL pipelines.

• Design and construct the Metadata and Authoritative Source Registry.

• Apply FIPS 140-compliant encryption and enforce NIST SP 800-171/800-172 security protocols and role-based access controls.

• Implement federal CUI Registry and data governance standards to manage platform data.

• Spearhead database performance monitoring and optimization initiatives.

• Contribute to database-layer decisions and documentation for the Data Model Harmonization Report.

• Oversee the database components of the production migration runbook and execute associated migration tasks.

• Contribute to the Production Deployment Report, detailing migration results, validation findings, and monitoring insights.

• Direct database documentation efforts for the Final Operational Playbooks.

⛳️ Requirements

• A Bachelor's degree with 12 years of professional experience, a Master's degree with 10 years of professional experience, an Associate's degree with 14 years of professional experience, or a high school diploma/equivalent with 16 years of professional experience.

• U.S. Citizenship is required.

• Capability to obtain and maintain a Public Trust clearance.

• Extensive experience in database engineering with a focus on cloud data platforms.

• Practical experience with Databricks, Delta Lake, or similar cloud data lakehouse solutions.

• Proficient in Python or Scala for implementing ETL pipelines, developing data quality frameworks, and creating database automation scripts.

• Familiarity with FIPS 140, NIST SP 800-171/800-172, and federal CUI data governance standards.

• Experience in designing and applying RBAC and data security controls in federal cloud environments.

• Proven track record in leading database migrations and production cutover activities in federal programs.

• Experience with version-controlled code repositories and enforcing peer review processes.

• Skilled in documenting post-deployment monitoring results and outcomes of production validation.

• Strong abilities in data modeling, schema design, and metadata management.

🏝️ Benefits

• Potential eligibility for overtime compensation.

• Shift differentials may be available.

• Discretionary bonuses may be offered.