Middle Data Engineer – Azure Databricks

This is a fully remote position, open to applicants in Romania.

📋 Description

• Design, develop, and maintain data pipelines utilizing Azure Databricks.

• Build and enhance data transformations using PySpark and SQL within Databricks.

• Implement and sustain Lakehouse architectures employing Delta Lake.

• Develop ETL/ELT pipelines orchestrated via Azure Data Factory.

• Integrate data from various sources into the data platform and analytical layers.

• Design and maintain data models and structures for data warehousing focused on analytics.

• Ensure the quality, scalability, and performance of extensive data processing pipelines.

• Collaborate with BI teams to support Power BI and reporting frameworks.

• Support and enhance existing SQL Server data platforms and ETL solutions (SSIS) as needed.

• Contribute to the architecture of modern cloud-based data systems.

⛳️ Requirements

• Over 3 years of experience in Data Engineering or Data Warehouse development.

• Proficiency with Azure Databricks.

• Experience in developing data pipelines using PySpark and Spark SQL.

• Strong understanding of distributed data processing and big data principles.

• Familiarity with Delta Lake and Lakehouse architectures.

• Strong SQL skills and experience with SQL Server relational databases.

• Experience in building data pipelines through Azure Data Factory.

• Experience managing large datasets and optimizing performance.

• Nice to have:

• Knowledge of Spark optimization techniques (e.g., partitioning, caching, cluster tuning).

• Experience with structured streaming in Databricks.

• Understanding of CI/CD pipelines for data platforms (Azure DevOps).

• Familiarity with Power BI.

• Experience transitioning from traditional ETL processes to cloud architectures.

🏝️ Benefits

• Culture of Relentless Performance: become part of an unstoppable technology development team with a 99% project success rate and over 30% year-over-year revenue growth.

• Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package, including health insurance and a relocation program.

• Work From Anywhere Culture: maximize the flexibility that remote work provides.

• Growth Mindset: benefit from a variety of professional development opportunities, including certification programs, mentorship, talent investment programs, internal mobility, and internship opportunities.

• Global Impact: collaborate on meaningful projects for top global clients and influence the future of industries.

• Welcoming Multicultural Environment: be part of a dynamic, global team and thrive in an inclusive and supportive workplace with open communication and regular team-building social events.

• Social Sustainability Values: engage with our sustainable business practices focused on five pillars: IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality.