Mid-Level Data Engineer, Databricks

This is a fully remote position, open to applicants in Maryland.

📋 Description

• Develop, test, and maintain data pipelines in Databricks utilizing Python, PySpark, and SQL.

• Transfer data from source systems into structured, reusable tables.

• Ensure data integrity by validating it against its sources, identifying discrepancies, and resolving quality issues before they impact reporting.

• Create documentation for pipelines, table definitions, and business rules.

• Take responsibility for assigned tasks from inception through delivery and ongoing production support.

• Proactively communicate risks and obstacles, keeping the team updated on progress.

• Collaborate with stakeholders and senior engineers to clarify project requirements.

• Adapt to new tools as project demands evolve.

• Provide dependable datasets for analytics, reporting, and automation for a federal government client.

⛳️ Requirements

• A bachelor's degree in computer science, data science, information systems, engineering, or a related discipline, or equivalent professional experience.

• A minimum of 5 years in data engineering, data analysis, or a comparable technical role.

• Practical experience in building pipelines within Databricks, including notebooks, PySpark or Spark SQL, and Delta tables.

• Strong skills in Python and SQL.

• Knowledge of ETL/ELT processes, data modeling, and data quality best practices.

• U.S. citizenship is mandatory.

• Must be eligible to obtain and maintain federal suitability, a government-issued PIV credential, and required system access.

• Experience with data ingestion via APIs is a plus.

• Familiarity with Unity Catalog, Databricks Jobs or Workflows, and CI/CD deployment is advantageous.

• Experience with Google Cloud Platform is a plus.

• Previous experience supporting a federal client is a plus.

🏝️ Benefits

• Comprehensive Health, Dental, & Vision Insurance.

• Short-Term Disability & Life Insurance.

• Matching 401(k) Contributions.

• Paid Time Off including 11 Holidays and your Birthday.

• Professional Development opportunities.

• Fitness Membership.

• Home Office allocations.

• Performance Bonuses & Profit Sharing.

• Employee Referral Bonuses.