Senior Data Engineer

This is a fully remote position, open to applicants in Ukraine.

📋 Description

• Create and develop batch data pipelines that acquire, validate, and transform datasets containing billions of rows.

• Construct intricate models that reflect real-world data and enhance these models securely.

• Design and manage workloads on a lakehouse platform as well as a data warehouse.

• Coordinate pipelines using Airflow.

• Validate accuracy and examine data inconsistencies.

• Develop and sustain Python services and REST APIs.

• Focus on performance optimization and cost efficiency.

• Oversee production pipelines and engage in incident management.

• Collaborate across various teams including product managers, data scientists, and stakeholders.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Computer Engineering, a related technical field, or equivalent practical experience.

• Over 7 years of experience working as a data engineer.

• Strong proficiency in Python, utilizing it as the primary programming language in recent roles.

• Advanced SQL skills.

• Practical experience with a distributed data processing platform (Spark/Databricks preferred).

• Capability to design intricate data models.

• Familiarity with workflow orchestration tools (Airflow or comparable).

• Experience in integrating third-party data sources.

• Proven experience in creating REST services using Python.

• Working knowledge of AWS and Docker.

• Solid understanding of engineering best practices and testing methodologies.

🏝️ Benefits

• Ukraine residency is required.

• Primarily remote work with occasional in-person meetings.

• Be part of an Agile team that regularly releases innovative new features.

• High level of ownership for projects.

• Opportunity to experiment with new technologies to enhance software.