This is a fully remote position, open to applicants in Slovenia.

• Developing and maintaining batch, incremental, and real-time ETL pipelines.

• Establishing standardized processes for data ingestion, validation, and cleansing across various clients.

• Implementing automation for data validation to enhance data quality.

• Overseeing and refining schemas throughout all segments of our pipeline.

• Monitoring, optimizing, and tuning Spark jobs for better performance.

• Gaining expertise in the domain of connected vehicle data.

• Over 3 years of experience as a data engineer.

• Background as a tech lead or mentor.

• Strong proficiency in Python/Scala/Java/C++ and SQL.

• More than 3 years of experience with Spark or similar technologies.

• At least 2 years of experience with workflow schedulers (such as Airflow, Prefect, Argo, etc.).

• A minimum of 2 years of experience with distributed file systems (like HDFS, S3, etc.).

• Familiarity with tools in the open-source data ecosystem (including Apache, CNCF, etc.).

• Experience with incremental or real-time processing (such as Delta Lake, Apache Hudi, Kafka Stream, Spark Streaming, etc.).

• Comprehensive health and wellness benefits.

• Opportunities for professional development and growth.

• Flexible working hours and remote work options.

• Collaborative and innovative work environment.

Data Engineer

People also viewed