Senior Data Engineer

📋 Description

• Design, develop, and implement data pipelines and ETL processes to effectively ingest, transform, and load data into the data platform.

• Collaborate with the Lead Architect and Cloud Engineer to ensure the smooth integration of data services within the cloud infrastructure.

• Create data models and schemas that facilitate efficient data storage and retrieval.

• Establish data quality and validation processes to guarantee the accuracy and consistency of data.

• Enhance data processes and queries for optimal performance and scalability.

• Work in partnership with business stakeholders to grasp their data needs and deliver insights and solutions for data-driven decision-making.

• Collaborate closely with data scientists to provide them with the essential data and tools required for developing revenue-generating insights and models.

• Implement data governance and security measures to ensure data privacy and compliance with relevant regulations.

• Stay informed about the latest data technologies and trends, making recommendations for technology adoption and enhancements.

⛳️ Requirements

• Strong understanding of Azure data tools, particularly Databricks.

• Demonstrated experience as a Data Engineer, utilizing Azure data services.

• Solid grasp of data modeling principles and both relational and non-relational databases.

• Proficient in SQL and experienced with data integration and ETL tools (e.g., Azure Data Factory, Azure Databricks).

• Familiarity with data warehousing concepts and technologies (e.g., Azure Synapse Analytics, Azure Data Lake Storage).

• Knowledge of big data technologies and frameworks (e.g., Hadoop, Spark) is advantageous.

• Understanding of data governance and data security best practices.

• Strong problem-solving abilities and meticulous attention to detail.

• Excellent communication and teamwork skills to collaborate effectively within a team environment.

• Experience with Agile methodologies is beneficial.

• Comfortable solving problems independently as well as collaboratively.

• Confident in reaching out to stakeholders and colleagues to resolve issues and gain insights.

• Adaptable to a remote working environment.

• Enthusiastic about new technologies and eager to learn about them.

🏝️ Benefits

• Competitive salary and compensation package.

• Exclusive access to AWS & Databricks certifications, training, and partner tools.

• Remote work with regular team social events.

• Opportunity to work with a highly skilled and motivated team of experts in Cloud, Big Data, and Machine Learning.