Data Engineer

This is a fully remote position, open to applicants in Hungary.

📋 Description

• Validation of central operations based on Databricks and ML-driven anomaly detection against threshold monitoring

• Development of streaming and batch pipelines for data integration

• Ensuring data quality, implementing quality gating, transformations, and auditing

• Conducting feature engineering and data exploration

• Collaborating with Operators from Bas

• Requesting and modifying KhZ waveform data

• Standardizing data KPIs and evaluating proof of concepts

• Bundling Infrastructure as Code (IaC) assets

• Performing unit testing and integration testing

• Creating documentation and formatting

• Mapping business pages

• Identifying data sources

• Connecting with domain expert colleagues

• Clarifying ownership of data

• Analyzing time series data

• Normalizing regimes

• Advancing the predictive maintenance journey

⛳️ Requirements

• Proficiency in Azure Databricks

• Experience with CI/CD processes

• Familiarity with MLflow

• Background in anomaly detection

• Knowledge of DLT, specifically Snowflake

• Proficient in English at a C1 level

🏝️ Benefits

• Competitive salary package

• Opportunities for professional development

• Flexible working hours

• Collaborative work environment