Senior Staff Platform/Data Reliability Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Take charge of operational excellence for the Databricks platform, which includes monitoring, alerting, observability, incident response assistance, and production runbook methodologies.

• Establish and uphold CI/CD and promotion standards for Databricks assets, workflows, jobs, notebooks, code packages, infrastructure configurations, and the transition from development to production environments.

• Create and sustain standards for job orchestration, cluster and compute policies, service principal utilization, environment isolation, and the reliability of production executions.

• Develop reusable operational templates and support mechanisms for new domains integrating with Databricks.

• Collaborate with the Senior Data Engineer to implement observable, recoverable, cost-effective, and secure ingestion and medallion patterns.

• Ensure that Databricks configuration and usage align with enterprise cloud standards and comply with commercial or government-hosted environments.

• Assist in enforcing technical controls for data segregation, access boundaries, and operational compliance.

• Monitor and enhance job success rates, incident trends, data pipeline reliability, cost efficiency, and environmental consistency.

• Document platform standards, operational expectations, and support frameworks.

• Provide mentorship to internal engineers as they develop responsibilities related to the platform.

⛳️ Requirements

• A minimum of 12 years of relevant experience in data platform engineering, platform operations, site reliability engineering, or modern cloud data infrastructure.

• Practical experience with Databricks or a closely related cloud data platform in a production setting.

• Proven experience in designing or managing CI/CD, environment promotions, version control, and deployment automation for data platforms and pipelines.

• In-depth knowledge of observability, monitoring, alerting, incident management, and reliability engineering.

• Experience with designing compute policies, workload isolation, service principals, and secure production execution patterns on cloud data platforms.

• Ability to work effectively within a regulated or security-sensitive environment, adhering to strong access control, auditability, and operational discipline requirements.

• Excellent collaboration skills and the ability to work alongside cloud/infrastructure, security, data engineering, and analytics stakeholders.

• Databricks certification and/or significant expertise with Delta Lake, Unity Catalog, Workflows, and Databricks Asset Bundles.

• Experience with infrastructure-as-code and platform automation in enterprise settings.

• Familiarity with supporting commercial and government or otherwise segregated environments that have varying compliance and access needs.

• Background in defense, aerospace, federal, or another regulated industry.

• A cleared background and potential reference checks are required for job offers.

• Authorization to work in the United States is necessary.

🏝️ Benefits

• Bonus

• Benefits

• Equity

• A temporary benefits package applicable after 60 days of employment

• Equal employment opportunity and affirmative action workplace

• Reasonable accommodations for disabilities or special needs