Senior Data Engineer, Flink

This is a fully remote position, open to applicants in Egypt.

📋 Description

• Develop and manage real-time streaming pipelines.

• Ensure low latency and maintain job recoverability during high volume operations.

• Oversee the health of the pipeline.

• Manage recovery processes in the event of job failures.

⛳️ Requirements

• Extensive hands-on experience with Apache Flink, including the DataStream API and Flink SQL.

• Proven experience with high-volume Kafka streaming and real-time data processing.

• In-depth understanding of event time processing, checkpointing, savepoints, and state management.

• Experience in data modeling for analytics and streaming into a lakehouse.

• Background in monitoring pipeline health and managing job recoveries and failures.

• Familiarity with Apache Iceberg or other open table formats.

• Experience with Airflow.

• Knowledge of on-premises or self-managed cluster environments.

• Proficient in Kafka, Java, Scala, Python, SQL, Docker, and Kubernetes.

🏝️ Benefits

• Comprehensive benefits package.

• Opportunities for professional development and growth.

• Collaborative and innovative work environment.