SQL Data Engineer

This is a fully remote position, open to applicants in Maryland.

📋 Description

• Design, create, and enhance scalable data pipelines, data models, and datasets ready for analytics utilizing advanced SQL and Databricks.

• Develop, optimize, and debug intricate SQL solutions across Oracle SQL, PostgreSQL, and Databricks SQL.

• Integrate data from various sources including databases, cloud data platforms, APIs, JSON, XML, and flat files.

• Establish automated testing, data validation, data reconciliation, and processes for ensuring data quality.

• Adapt solutions across diverse SQL dialects and database environments.

• Work in collaboration with data engineers, analysts, software developers, data scientists, and client stakeholders to deliver secure and high-performance solutions.

• Convey technical concepts effectively to both technical and non-technical audiences.

• Proactively raise questions, identify risks, and suggest actions to management at the earliest opportunity.

⛳️ Requirements

• A Bachelor’s degree in Computer Science, Data Science, Engineering, Statistics, Biostatistics, or Mathematics is required.

• A minimum of 5 years of experience in developing, optimizing, and troubleshooting complex SQL solutions.

• Capability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements.

• U.S. citizenship is mandatory to support this federal contract.

• Proficient in Oracle SQL, PostgreSQL, and Databricks SQL, including skills in queries, stored procedures, views, functions, and data transformations.

• At least 2 years of experience with Databricks, including Databricks Workspace, notebooks, jobs, workflows, Apache Spark, Delta Lake, and cluster configuration.

• Familiarity with relational databases, data modeling, dimensional modeling, data warehousing, and medallion architecture patterns.

• Proven experience in data integration from databases, cloud data platforms, APIs, JSON, XML, and flat files.

• Experience in developing data engineering solutions using Python and managing code via Git or similar source-control tools.

• Competence in implementing automated testing, data validation, data reconciliation, and data-quality processes.

• Ability to work independently in an Agile, collaborative, and client-focused setting while troubleshooting complex issues.

• Experience with advanced capabilities in Databricks, including Delta Live Tables, Workflows, and Unity Catalog.

• Expertise in developing and optimizing ETL and ELT transformation workflows.

• Experience with Pentaho or comparable data integration and ETL tools.

• Familiarity with implementing CI/CD pipelines, automated deployments, and software development methodologies for data solutions.

• Experience utilizing AI-enabled tools or techniques to enhance data engineering workflows, pipeline performance, or developer productivity.

• Knowledge of data governance, metadata management, data lineage, privacy, security, and access controls.

• Experience supporting federal health data systems, regulatory science, or other regulated data environments.

• Possession of a Databricks, AWS Cloud, or data engineering technical certification.

🏝️ Benefits

• Competitive salary and performance-based incentives.

• Comprehensive health, dental, and vision insurance plans.

• Opportunities for professional development and continuous learning.

• Flexible work arrangements and life balance initiatives.

• Generous paid time off and holiday policies.