Azure Data Engineering Architect, Freelance

This is a fully remote position, open to applicants in Poland.

📋 Description

• Work collaboratively with stakeholders to comprehend business needs and convert them into effective data engineering solutions.

• Design and manage scalable, high-performance, secure, and maintainable data architecture and infrastructure.

• Establish data models and schemas that align with business requirements and data characteristics.

• Choose and integrate various databases, data lakes, data warehouses, and big data frameworks.

• Develop scalable ETL processes, data pipelines, and solutions for data integration.

• Ensure that data engineering solutions are aligned with the organization's long-term data strategy.

• Assess and propose practices for data governance, privacy, security, and compliance.

• Collaborate with data scientists, analysts, and stakeholders to outline data requirements and facilitate analysis and reporting.

• Provide technical mentorship to data engineering teams and assist with implementation.

• Supervise the implementation process in accordance with design documents and technical specifications.

• Stay updated on emerging trends in data engineering and suggest innovative solutions.

• Analyze and enhance system performance, addressing bottlenecks and inefficiencies.

• Ensure data quality and integrity through thorough validation and monitoring.

• Integrate data engineering solutions with other systems and applications as needed.

• Engage in project planning and estimation activities.

• Document data architecture, infrastructure, and design decisions comprehensively.

⛳️ Requirements

• Demonstrated experience as a Data Engineering Architect or in a comparable role.

• Extensive background in the Data & Analytics domain.

• Strong comprehension of data modeling, ETL processes, data pipelines, and data governance.

• Proficiency in designing and executing scalable and efficient data processing frameworks.

• Detailed knowledge of relational databases, NoSQL databases, data lakes, data warehouses, and big data frameworks like Hadoop and Spark.

• Experience in selecting and integrating technologies to fulfill business needs and long-term data strategy.

• Capability to convert stakeholder business requirements into effective data engineering solutions.

• Excellent analytical and problem-solving abilities.

• Proficiency in Python, PySpark, and SQL.

• Familiarity with AWS, GCP, or Azure, along with experience in designing and implementing cloud data solutions.

• Understanding of data governance principles, data privacy, and security regulations.

• Outstanding communication and collaboration skills.

• Experience in leading and mentoring data engineering teams.

• Familiarity with agile methodologies and development environments.

• Commitment to continuous learning.

• Strong project management abilities.

• Solid understanding of distributed computing principles, including parallel processing, data partitioning, and fault tolerance.

• Bachelor's degree in Computer Science, Information Technology, or a related field is required.

• A Master's degree may be preferred.

🏝️ Benefits

• An inclusive workplace dedicated to diversity, equity, and inclusion.

• Equal opportunity employment.

• A safe and respectful work environment.

• A culture where employees feel valued and empowered to learn and grow.