Senior Data Engineer – Databricks, Azure Data Platform

This is a fully remote position, open to applicants in Switzerland.

📋 Description

• Assist in the establishment and ongoing enhancement of a contemporary data platform within the insurance and reinsurance sector.

• Participate in the design, construction, and maintenance of a scalable data platform utilizing Databricks on Azure.

• Consolidate disparate data sources and implement data quality assurance processes.

• Organize data into significant business domains while providing dependable data layers for reporting, applications, analytics, and prospective AI initiatives.

• Construct, manage, and optimize data pipelines in Databricks.

• Conceptualize and execute scalable Lakehouse and Medallion Architecture frameworks.

• Arrange data into relevant business domains.

• Develop and sustain Bronze, Silver, and Gold data layers.

• Create Gold layers to facilitate business needs, particularly for applications, reports, and analytics.

• Integrate and process data from various source systems, predominantly SAP.

• Execute data quality checks, monitoring, and validation processes.

• Assist with data modeling, database design, storage solutions, and performance enhancement.

• Contribute to governance, security, and access management frameworks.

• Support or establish CI/CD pipelines for data engineering processes.

• Address reporting needs, likely using Power BI and/or Databricks.

• Prepare the data platform for upcoming AI and advanced analytics applications.

• Facilitate seamless onboarding of business users onto the data platform.

• Collaborate closely with infrastructure, architecture, business, reporting, and data teams.

⛳️ Requirements

• Several years of experience as a Senior Data Engineer or a similar position.

• Extensive experience in constructing and sustaining data pipelines using Databricks.

• In-depth knowledge of Lakehouse Architecture and Medallion Architecture.

• Proficient experience with cloud-based data platforms, preferably on Azure.

• Strong comprehension of data quality, data governance, security, and access management.

• Experience with data modeling, databases, storage technologies, and performance optimization.

• Familiarity with CI/CD principles in a data engineering context.

• Good understanding of the Databricks ecosystem and its related components.

• Experience with SAP data sources is a significant advantage.

• Background in insurance, reinsurance, finance, or actuarial fields is beneficial.

• Knowledge of Power BI and/or Databricks reporting tools is an asset.

• Capability to organize complex data landscapes and convert them into scalable solutions.

• Independent, senior-level, and structured approach to work.

• Strong communication abilities with both technical and business stakeholders.

🏝️ Benefits

• Flexible work arrangements.

• Professional development opportunities.