Senior Data Engineer

This is a fully remote position, open to applicants in Romania.

📋 Description

• Design, construct, and maintain scalable ETL/ELT pipelines utilizing Apache NiFi

• Implement and oversee Apache Iceberg data lakehouse structures, encompassing schema evolution, partitioning, and time travel

• Develop and enhance SQL queries and data access layers with Trino

• Integrate various data sources such as Kafka, S3, RDBMS, and REST APIs into cohesive pipelines

• Ensure data quality, security, and governance across the data infrastructure

• Conduct performance tuning, monitoring, and troubleshooting of data pipelines and distributed systems

• Collaborate with data scientists, platform engineers, and business stakeholders

• Document technical designs, concepts, and processes

• Contribute to the migration of the platform to Kubernetes, Apache Iceberg, and other cutting-edge infrastructure technologies by 2026

• Develop and sustain data infrastructure for AI-driven automation services in the accounting and finance sectors

⛳️ Requirements

• Proven expertise in Apache Iceberg, Apache NiFi, and Trino

• Familiarity and capability to work with Apache Spark code

• Experience in ETL/ELT processes and API integration

• Practical knowledge in real-time streaming with Apache Kafka

• Strong foundation in large-scale data processing and distributed systems

• Experience with cloud platforms like AWS, Azure, or GCP, particularly S3, IAM, and Glue

• Proficiency in Python, Java, or Scala

• Hands-on experience with Docker and Kubernetes

• Familiarity with Git, Jenkins, Terraform, and GitHub Actions

• Experience with Prometheus, Grafana, ELK Stack, or Splunk

• Strong understanding of SQL and performance optimization techniques

• Structured and solution-oriented approach to work

• Excellent communication and collaboration skills within interdisciplinary teams

• Ability to document and articulate complex technical processes clearly

🏝️ Benefits

• International and agile work environment

• Emphasis on diversity, creativity, and collaboration

• Opportunity to engage with advanced technologies like Kubernetes and Apache Iceberg

• Work on scalable, stable, and performance-oriented data infrastructure

• Participation in the modernization of the platform by 2026

• Involvement with artificial intelligence and machine learning services in the finance sector