Senior Data Engineer

This is a fully remote position, open to applicants in Ukraine.

📋 Description

• Design and execute scalable data platforms and pipelines across cloud environments.

• Create reliable batch, streaming, and near-real-time pipelines utilizing technologies such as Spark and Delta Lake.

• Construct ingestion, transformation, and curation workflows for both structured and unstructured data.

• Implement advanced data architectures, including lakehouse patterns and medallion layering.

• Provide high-quality datasets that facilitate analytics, machine learning, causal modeling, and optimization systems.

• Enable data pipelines for Generative AI use cases.

• Design scalable logical and physical data models.

• Orchestrate workflows using tools like Airflow, dbt, Lakeflow, or their equivalents.

• Apply contemporary architecture patterns, including event-driven and streaming architectures.

• Establish robust data observability, focusing on monitoring data freshness, pipeline reliability, and SLA adherence.

• Enable data serving layers to support downstream systems.

⛳️ Requirements

• Extensive hands-on experience with Apache Spark and Delta Lake.

• Strong programming capabilities in Python and SQL.

• Demonstrated experience in building batch and streaming data pipelines.

• Comprehensive understanding of data modeling, data quality, and governance principles.

• Experience with one or more leading cloud platforms, preferably Microsoft Azure / Fabric, along with AWS or GCP.

• Familiarity with modern data platforms such as Databricks and Snowflake.

• Experience with lakehouse architectures and distributed data systems.

• Strong comprehension of scalability, reliability, and performance considerations in data pipelines.

• Excellent problem-solving abilities with a focus on scalability and reliability.

• Experience in Agile or consulting environments is advantageous.

🏝️ Benefits

• Medical insurance.

• Sports reimbursement budget.

• Home office support.

• Access to a number of free psychological and legal consultations.

• Maternity and paternity leave support.

• Internal workshops and learning initiatives.

• Compensation for English language classes.

• Reimbursement for professional certifications.

• Participation in professional communities at both local and global levels.

• Growth Framework to manage expectations and outline steps for career advancement.

• Mentoring program offering opportunities to become either a mentor or a mentee for career progression.

• Valtech Ukraine has a progressive benefits package — the longer your tenure with the company, the more benefits you receive.