Data Solution Engineer

This is a fully remote position, open to applicants in Virginia.

📋 Description

• Design, test, and deploy data pipelines within Databricks utilizing SQL, Python, and Apache Spark.

• Assist with pilot programs, proof-of-concept initiatives, and operational data workflows.

• Create and sustain pipelines across bronze, silver, and gold medallion architecture layers.

• Enforce data governance tagging, metadata standards, and classification roles within Unity Catalog.

• Implement column masking, access controls, and reference data lookups.

• Establish and manage pipeline and workflow configurations through YAML and configuration-as-code methodologies.

• Conduct data quality testing and validation to ensure accuracy, completeness, consistency, compliance, data contracts, and adherence to business rules.

• Manage Controlled Unclassified Information (CUI) while adhering to relevant safeguarding requirements.

• Occasionally travel for project-related needs, client meetings, team collaboration events, or training; travel is anticipated to be under 10%.

⛳️ Requirements

• DHS Suitability is required.

• A BS/BA degree and 3–5 years of experience in data engineering, including practical experience with Databricks, Spark, and YAML, or an equivalent combination of education and experience.

• Proven experience in designing data governance, tagging, and metadata standards.

• In-depth knowledge of the medallion architecture and the evolution of metadata, sensitivity, and access requirements across Bronze, Silver, and Gold layers.

• Experience in implementing column masking, row-level security, and dynamic access controls.

• Capacity to reconcile conflicting requirements from various stakeholders.

• Strong proficiency in SQL and Spark.

• Expertise in defining pipeline configuration and data contracts declaratively (e.g., YAML) as version-controlled, enforceable artifacts.

• Familiarity with a cybersecurity environment is preferred.

• Only U.S. citizens are eligible for this position.

• Capability to obtain and maintain a Public Trust or Suitability Determination.

🏝️ Benefits

• Health Care Plan (Medical, Dental & Vision).

• Retirement Plan (401k).

• Life Insurance (Basic, Voluntary & AD&D).

• Paid Time Off.

• Family Leave (Maternity, Paternity).

• Short Term & Long-Term Disability.

• Training & Development.