Senior Data Engineer

This is a fully remote position, open to applicants in Sweden.

📋 Description

• Design and develop the Enterprise Data Catalog application, encompassing both front-end and back-end components.

• Integrate the application with Unity Catalog APIs, Databricks services, metadata sources, and external systems.

• Implement secure authentication, single sign-on (SSO), role-based and group-based authorization, along with user-context data access.

• Create high-performance metadata search, caching, and indexing to accommodate a large user base.

• Establish CI/CD processes, automated testing, audit logging, monitoring, and application observability.

• Assist in deployment, security and architecture reviews, troubleshooting, and performance optimization.

• Generate maintainable code, configuration, and technical documentation.

• Facilitate knowledge transfer.

• Participate in setting standards, establishing guidelines, and sharing best practices.

⛳️ Requirements

• Over 5 years of experience as a Data Engineer.

• Expertise in Databricks.

• Experience in application development using React, Node.js, Python, Streamlit, or similar technologies.

• Familiarity with integrating Unity Catalog APIs and metadata services.

• Proven experience with implementing OAuth, Microsoft Entra ID, SSO, RBAC, and group-based authorization.

• Experience in designing enterprise-scale web applications that cater to large user groups.

• Strong understanding of Databricks SQL, Serverless SQL, Jobs, Lakehouse architecture, and governance.

• Knowledge of integrating external systems via REST APIs.

• Experience with CI/CD, Git, and Azure DevOps or GitHub Actions.

• Proficiency in English at an upper-intermediate level or higher.

• Experience with MCP / JSON-RPC integration patterns.

• Familiarity with Databricks Genie and Genie Ontology.

• Knowledge of Unity Gateway or other comparable governed data-access patterns.

🏝️ Benefits

• Equal opportunities provided regardless of race, ethnicity, gender identity, sexual orientation, disability, age, religion, or any other characteristic.

• A respectful and inclusive work environment.

• Fully remote work arrangement.