Data Engineer

This is a fully remote position, open to applicants in Germany.

📋 Description

• Develop and manage the data infrastructure that powers CIVORA, DKSR’s urban data hub for cities and regions.

• Contribute to the development of platform components and internal tools.

• Collaborate with product and project delivery teams to create reusable, scalable, and well-documented data infrastructure.

• Design and oversee batch and streaming data pipelines that cater to multiple cities and various use cases.

• Support complex and mission-critical use cases while establishing best practices and design patterns.

• Write clean, maintainable, and testable software.

• Propose and prototype innovative approaches while challenging existing patterns.

• Comprehend business challenges, refine requirements, design systems, and deliver end-to-end solutions.

• Work closely with the Data Architect and the product development team.

⛳️ Requirements

• 1–3 years of relevant experience in data engineering and software development.

• B.Sc. in Computer Science, Data Science, Data Engineering, or a related field; equivalent professional experience is also accepted.

• Proficiency in Python for data processing using pandas, NumPy, and scikit-learn, along with solid software development practices.

• Knowledge of SQL and an understanding of relational database design.

• Practical experience with Apache Airflow or a similar pipeline orchestration tool.

• Familiarity with the Kafka protocol or comparable streaming systems.

• Experience with Docker containerization.

• Working knowledge of cloud concepts and infrastructure-as-code principles, including Helm and Terraform.

• Comfortable communicating in both spoken and written English.

• Proactive team player with direct communication skills.

• Experience with agentic development using GitHub, Copilot, or Claude.

• Kubernetes experience is preferred.

• Hands-on experience with AWS, Azure, or GCP is advantageous.

• Ability to read and work with Java, JavaScript, Rust, or Go is a plus.

• Willingness to learn and operate technologies such as Helm, OpenTofu/Terraform, MinIO/SeaweedFS, Apache Superset, Apache Iceberg, Lakekeeper, Redpanda, Kafka Connect, Trino, and MLflow.

• Proficiency in German is not required but highly valued.

• Must currently reside in Germany and be legally authorized to work there.

• Visa sponsorship and relocation support are not available.

🏝️ Benefits

• Job Ticket or Job Bike – for a sustainable commute.

• Professional development budget.

• 30 days of vacation, plus time off on December 24 and December 31.

• Corporate Benefits.

• Subsidy for Urban Sports Club.

• Open feedback culture.

• Support when you need it – and space when you want it.