Data Engineer – Databricks

This is a fully remote position, open to applicants in Maryland, +1 more state.

📋 Description

• Create and implement scalable solutions utilizing Databricks along with ETL/ELT pipelines.

• Adhere to Databricks development standards and implement best practices in data engineering.

• Manage and oversee enterprise environments for MariaDB and SQL Server.

• Design and structure databases, including schemas, tables, views, stored procedures, functions, and triggers.

• Execute database configuration, backup, restoration, performance optimization, and disaster recovery tasks.

• Enhance SQL queries, indexes, database objects, pipelines, and server performance.

• Set up and maintain availability groups, mirroring, clustering, encryption, and reporting servers.

• Employ best practices for data modeling, relational database design, data warehousing, data quality, and data lineage.

• Enforce database security measures, auditing, user access controls, roles, permissions, and domain-level accounts.

• Diagnose complex issues related to databases, applications, and data pipelines.

• Collaborate with business stakeholders, infrastructure, network, application, development, and vendor teams.

• Convert business and technical requirements into secure, scalable data solutions.

• Provide technical demonstrations, training, and assist with proposal efforts.

• Serve in a customer-facing capacity supporting the Department of Transportation (DOT).

⛳️ Requirements

• A Bachelor’s degree in Computer Science, Computer Engineering, Mathematics, Statistics, or a related technical field.

• Over 5 years of experience in data engineering, database administration, or database development.

• Proven hands-on experience with Databricks.

• Experience in managing SQL Server and/or MariaDB enterprise databases.

• Advanced SQL proficiency, including the development and optimization of queries, stored procedures, functions, triggers, tables, and views.

• Proficient in programming languages such as Python, Java, or Scala.

• Familiarity with developing ETL/ELT pipelines using tools like Apache Airflow, AWS Glue, or other similar technologies.

• Experience in database performance tuning, backup and restoration, disaster recovery, security, and access management.

• U.S. citizenship and the capability to obtain and maintain a federal Public Trust as per contract requirements.

• Proven experience in leading or providing technical guidance to engineering teams.

• Strong skills in stakeholder engagement, communication, collaboration, and problem-solving.

🏝️ Benefits

• Comprehensive medical, dental, and vision plans

• Flexible Spending Account

• 4% 401K Match (immediate vesting)

• Paid Time Off

• Tuition reimbursement, certification programs, and professional development

• Flexible work schedule

• On-site gym and childcare option