Data Engineer

This is a fully remote position, open to applicants in Netherlands.

📋 Description

• Design and develop a greenfield data mesh platform utilizing AWS.

• Establish a scalable data infrastructure for a major distribution firm.

• Assist in constructing a stream processing backend leveraging AWS services, Spark, and Kafka.

• Ensure the robustness of data pipelines and their ability to manage low-quality raw data efficiently.

• Collaborate effectively within a small team to meet project objectives.

⛳️ Requirements

• A minimum of 2 years of practical experience with AWS services such as Lambda functions, EMR, ElasticSearch, Lake formation, and Glue.

• Strong technical proficiency in Scala and/or Python.

• Previous experience with ZIO is highly advantageous.

• A solid understanding (and ideally experience) in creating pub-sub and asynchronous systems using Apache Kafka or any other messaging API.

• Ability to analyze algorithm complexity and knowledge of data structures beyond "List and Stack."

• Over 3 years of experience working with Linux/macOS, Docker, and Git in collaborative settings.

• More than 5 years of experience in developing greenfield projects from inception in a live environment with stringent high availability demands is a plus.

🏝️ Benefits

• 100% Open and Transparent company

• Flexible work arrangements

• Professional development opportunities

• Health insurance

• Remote work options