Senior Data Engineer

This is a fully remote position, open to applicants in Maryland.

📋 Description

• Oversee workspace architecture, governance of Unity Catalog, and design of cluster policies for IRS tenant organizations.

• Conduct tenant discovery and gather requirements, including source profiling and security classification for new data intake requests.

• Create comprehensive technical designs for tenant onboarding, encompassing Data Sharing Agreements and SLA documentation.

• Manage the Requirements Traceability Matrix (RTM) and prepare submissions for the Architecture Review Board (ARB).

• Contribute to the automation of tenant onboarding, integration of financial operations, and reporting on ROI.

• Produce training materials for tenants and lead weekly office hours for IRS program teams.

• Assist in P1/P2 incident response adhering to SLA for tenant-related platform issues.

• Supply NIST 800-53 control evidence within five business days of IRS audit requests.

• Aid IRS data platform initiatives by ensuring secure and scalable architecture along with tenant onboarding in a Databricks and AWS environment.

• Collaborate with stakeholders to enhance platform adoption and achieve operational excellence.

⛳️ Requirements

• Active Minimum Background Investigation (MBI) is required; candidates currently undergoing this process are not eligible.

• U.S. Citizenship is mandatory.

• Minimum of 8 years in cloud data engineering.

• 3 to 5 years of direct experience with Databricks, including Unity Catalog, Delta Live Tables, Auto Loader, and Genie.

• Must possess a current and valid Databricks Certified Data Engineer Professional certification or an equivalent advanced certification at the time of contract award.

• AWS Certified Solutions Architect or Data Engineer certification at either Associate or Professional level is required.

• Extensive experience with medallion architecture (Bronze/Silver/Gold), Delta Lake, and Change Data Capture (CDC) patterns.

• Proficient in Python, PySpark, and SQL for developing enterprise pipelines.

• Practical experience with AWS services including S3, IAM, VPC, CloudWatch, Glue, and Athena.

• Knowledge of RBAC/ABAC, row-level security, and PII column masking is necessary.

• Familiarity with IRS OneSDLC, FISMA, NIST 800-53, and FedRAMP High is preferred.

• Bachelor's degree in Computer Science, Information Technology, or a related field is required.

• Previous experience with IRS contracts is strongly preferred.

• Familiarity with Terraform, GitHub Actions or Azure DevOps, Kafka/MSK, dbt, Great Expectations, Splunk/Datadog, Collibra/Alation, AWS Lake Formation, data mesh, or modern data product architectures is a plus.

• Must meet eligibility requirements for access to classified information and obtain a government-granted security clearance.

• Candidates may be subject to criminal history checks, employment and education verification, drug testing, and creditworthiness investigations.

🏝️ Benefits

• Military Veterans are strongly encouraged to apply.

• Compensation decisions take into account location, skill sets, experience and training, security clearances, licensure and certifications, and other organizational and business needs.