Data Engineer

This is a fully remote position, open to applicants in Greece.

📋 Description

• Design, construct, and enhance the company’s data infrastructure.

• Develop intricate, high-volume batch and near-real-time ingestion services.

• Contribute to the advancement of the platform’s streaming capabilities.

• Create and implement data solutions tailored to application requirements in a distributed microservices setting.

• Build and refine large-scale batch and streaming data pipelines.

• Ensure data quality, compliance, and governance are maintained.

• Oversee and enhance Kubernetes infrastructure utilizing KEDA for dynamic resource scaling.

• Manage the entire data stack lifecycle with Terraform and Kubernetes, from provisioning to application-level frameworks.

• Offer technical direction and promote best practices for infrastructure, CI/CD, testing, and system design.

• Conduct memory management and performance tuning for large-scale distributed systems.

⛳️ Requirements

• Over 5 years of experience as a Data Platform/Infra Engineer.

• A proven history of constructing and managing scalable data infrastructure within Data Lake architectures.

• Demonstrated experience in designing and managing large-scale data processing workloads on Kubernetes, including workload autoscaling with KEDA.

• Strong expertise in Python and SQL.

• Practical experience with Infrastructure as Code, preferably using Terraform.

• Familiarity with managing a data orchestration platform such as Airflow or Prefect.

• Experience with Snowflake.

🏝️ Benefits

• Remote work opportunities for candidates located in the Athens metropolitan area.