Senior Data Engineer

This is a fully remote position, open to applicants in Ukraine.

📋 Description

• Design, develop, and manage infrastructure for analyzing extensive data sets.

• Collaborate with data scientists, analytics teams, and stakeholders to identify and prioritize data engineering initiatives.

• Align data infrastructure with organizational goals and objectives.

• Create, develop, and sustain data pipeline architecture for extracting, transforming, and loading data from external APIs, data streams, and data repositories.

• Monitor and enhance the performance and reliability of data infrastructure.

• Improve scalability, efficiency, and security measures.

• Stay updated on data engineering trends and pinpoint opportunities for organizational enhancement and innovation.

• Resolve complex issues in a fast-paced, evolving environment while ensuring high quality.

• Implement data privacy and security protocols in compliance with security standards and frameworks.

• Strengthen the team's DevOps capabilities.

⛳️ Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related discipline.

• Over 2 years of demonstrated experience in developing large-scale software using an object-oriented or functional programming language.

• More than 5 years of professional experience in data engineering, specializing in the construction and maintenance of data pipelines and data warehouses.

• Strong proficiency in Spark, Scala, and Python, with the ability to write high-performance, maintainable code.

• Experience with AWS services, including EC2, S3, Athena, Kinesis/Firehose, Lambda, and EMR.

• Familiarity with data warehousing concepts and technologies, such as columnar storage, data lakes, and SQL.

• Experience with data pipeline orchestration and scheduling using tools such as Airflow.

• Strong problem-solving abilities and capacity to work independently as well as part of a team.

• Proficiency in English - a must.

• Excellent collaboration skills.

• Expertise in Vertica or Redshift, including query optimization and performance tuning (nice to have).

• Experience with machine learning and/or data science projects (nice to have).

• Knowledge of data governance and security best practices, including GDPR and CCPA (nice to have).

• Understanding of Spark internals, including tuning and query optimization (nice to have).

🏝️ Benefits

• Options for remote work.

• Continuous learning and career growth opportunities.

• A flexible and balanced work environment.

• Support for personal well-being.