Senior Data Platform Engineer

This is a fully remote position, open to applicants in Greece.

📋 Description

• Develop intricate, high-volume batch and near-real-time data ingestion services.

• Assist in enhancing the platform’s streaming functionalities.

• Create and execute data solutions tailored to application requirements within a distributed microservices framework.

• Build and refine large-scale data pipelines catering to both batch and streaming scenarios.

• Guarantee data quality, compliance, and governance standards are met.

• Oversee and enhance Kubernetes infrastructure utilizing KEDA to dynamically scale resources for extensive data processing tasks.

• Take ownership of the entire data stack lifecycle with Terraform and Kubernetes, from provisioning to application-level frameworks.

• Offer technical direction and promote best practices related to infrastructure, CI/CD, testing, and system architecture.

• Execute memory management and performance optimization for large-scale distributed systems.

⛳️ Requirements

• Over 5 years of experience as a Data Platform/Infra Engineer.

• Documented success in constructing and maintaining scalable data infrastructure, particularly within Data Lake architectures.

• Established experience in designing and managing large-scale data processing workloads on Kubernetes, including workload autoscaling using KEDA.

• Strong skills in Python and SQL.

• Practical experience with Infrastructure as Code, ideally using Terraform.

• Experience managing a data orchestration platform like Airflow or Prefect.

• Familiarity with Snowflake.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Flexible working hours and the option for remote work.

• Opportunities for professional development and training.

• Collaborative and innovative work environment.