Databricks Platform Engineer – DevSecOps

This is a fully remote position, open to applicants in United States.

📋 Description

• Take ownership of the environments, deployment pathways, and platform operations supporting production data products for a federal agency.

• Establish and manage Azure Databricks environments, ensuring proper access, secrets management, and networking configurations.

• Develop deployment automation to facilitate transitions between environments through Declarative Automation Bundles, infrastructure as code, and CI/CD pipelines.

• Optimize Delta pipelines and enhance platform performance.

• Oversee platform operations and create operational runbooks.

• Assist with environment parity, migration, and cutover activities in collaboration with the Databricks team under the Peregrine change control process.

• Handle bindings, rollback procedures, and documentation required for release reviews.

• Automate promotion processes, validations, and release documentation.

• Work closely with developers, engineers, data scientists, architects, and strategists across various projects and clients.

• Contribute to the development of the firm's capabilities, tools, and business lines.

⛳️ Requirements

• Over 4 years of experience in platform engineering, DevSecOps, or cloud infrastructure.

• Practical experience with the Azure Databricks platform, including Unity Catalog and Delta pipeline optimization.

• Proficiency in deployment automation and environment promotion, encompassing infrastructure as code and CI/CD pipelines.

• Knowledge of cloud networking, secrets management, and least-privilege access design in a regulated environment.

• Experience in platform operations for a production data platform.

• Support for migration and cutover, including environment parity, rollback strategies, and release-review documentation.

• Scripting skills in Python or Bash, along with experience in Git-based version control.

• Exposure to platform or DevSecOps work in at least one additional cloud environment besides Databricks, such as Microsoft Azure, AWS, or Google Cloud.

• Experience delivering in a federal government setting, adhering to its security, access, and review protocols.

• Strong written communication skills, as well as proficiency in PowerPoint and Excel.

• Preferred: experience with a federal system accredited at Impact Level 5 (IL-5) or higher.

• Preferred: familiarity with Declarative Automation Bundles, Terraform, or Azure DevOps pipelines.

• Preferred: certifications in Databricks, Azure, or AWS.

• Preferred: experience in federal security supporting compliance frameworks, security controls, and authorization documentation.

• Preferred: knowledge of AI-assisted developer tools.

• Preferred: U.S. citizenship; dual citizenship and green card holders are not eligible due to contract stipulations.

• Preferred: ability to meet required suitability, security, and access criteria.

🏝️ Benefits

• Comprehensive medical, dental, and vision coverage, with the employee premium fully covered and half of dependent premiums paid.

• Employer-funded life insurance, accidental death coverage, and short-term and long-term disability insurance.

• 401(k) plan with a 100% match up to 4% of salary, with immediate vesting.

• Unlimited paid time off.

• Sponsorship for professional certifications and ongoing education.

• Robust onboarding process.

• Opportunities for rotation across functions to broaden skills and perspectives.