Data Quality Engineer, QA

This is a fully remote position, open to applicants in Hungary.

📋 Description

• Design and execute a thorough data quality framework across the enterprise lakehouse platform.

• Create automated data quality testing suites utilizing Great Expectations, dbt tests, or Soda Core.

• Develop dashboards and scorecards focused on data quality for both data producers and consumers.

• Implement solutions for anomaly detection and data observability.

• Integrate quality assurance checks into CI/CD pipelines.

• Define and oversee data quality SLAs at both the pipeline and data product levels.

• Address and resolve data quality incidents in collaboration with upstream source owners.

• Work alongside the data governance team to uphold quality standards in accordance with business glossary definitions.

• Profile new data sources during the onboarding process and establish baseline quality metrics.

• Educate data engineering and product teams on data quality standards and measurement methodologies.

• Engage in the recruitment process and, if successful, become part of the talent pool for future job openings.

⛳️ Requirements

• Minimum of 4 years of experience in data engineering, data quality, or analytics engineering roles.

• Practical experience with Great Expectations, dbt tests, Soda, Monte Carlo, or comparable data quality tools.

• Proficient in SQL and Python for crafting validation logic and executing quality metric queries.

• Familiarity with Apache Spark or dbt for extensive data transformation and testing.

• Understanding of data profiling techniques and statistical methods for anomaly detection.

• Knowledge of data observability principles applicable in lakehouse environments.

• Experience with Airflow or other orchestration tools.

• Bachelor's degree in Computer Science, Statistics, Engineering, or a related discipline.

• Preferably experienced with Databricks or Snowflake's native data quality features.

• Familiarity with DataHub or data catalog integration is preferred.

• Knowledge of data contracts and shift-left quality methodologies in data mesh architectures is preferred.

• Currently residing in Hungary.

• Must have the legal right to live and work in Hungary.

🏝️ Benefits

• Competitive salary.

• A comprehensive benefits package tailored for Hungary.

• Support for maintaining well-being and a healthy work-life balance.

• A collaborative and inclusive company culture.

• Opportunities for professional growth.

• Access to the Global Power Your Career conference for networking, learning, and growth.

• Participation in the High-Potential Program, offering hands-on professional development.

• Leadership Challenges that provide essential skills and insights for managers and aspiring leaders.