Lead Data Platform Engineer – AWS, Freelance

This is a fully remote position, open to applicants in Ireland.

📋 Description

• Oversee the hands-on development of scalable data platforms on AWS, including Data Lakes, Lakehouses, and Data Warehouses.

• Design and create data pipelines utilizing AWS Glue, Athena, Redshift, EMR, and Kinesis.

• Develop batch and streaming solutions using Spark, Kafka, and technologies like Apache Iceberg or Delta Lake.

• Make architectural choices regarding platform design, data integration, and semantic layers.

• Implement orchestration with tools such as Airflow/MWAA, Step Functions, and dbt.

• Establish practices for security, governance, and compliance using IAM, KMS, and principles of GDPR.

• Automate infrastructure and deployment processes through Terraform, CI/CD, and DataOps methodologies.

• Lead technical deliveries, perform code reviews, and mentor Data Engineers.

⛳️ Requirements

• Extensive practical experience in engineering AWS data platforms.

• Strong expertise in AWS analytics tools, specifically Glue, Athena, Redshift, and EMR.

• Familiarity with Spark, Kafka, and contemporary Lakehouse technologies.

• Proficient in Python and SQL development.

• Experience with Terraform, CI/CD, and DataOps processes.

• Capability to make architectural decisions while actively engaging in engineering tasks.

• Proven experience in leading technical teams and conducting code reviews.

• Excellent communication skills in English.

• Proficiency in German is a plus.

• AWS certifications are preferred.

🏝️ Benefits

• Flexible working hours.

• Autonomy in selecting your own projects.

• Opportunity to engage in exciting projects across various industries.

• Support for career advancement.

• Dedicated team support.

• Chance to work independently.

• Access to a robust professional network.