Data Engineer

This is a fully remote position, open to applicants in Poland.

📋 Description

• Design, develop, and sustain scalable data processing pipelines utilizing SQL, Python, and Apache Spark / PySpark.

• Work with unprocessed data and devise methods for its incorporation into the data platform.

• Create CI/CD pipelines for data engineering solutions.

• Develop and maintain Infrastructure as Code solutions.

• Integrate the data platform with various systems and applications.

• Engage in architectural decision-making and establish engineering standards.

• Perform code reviews, document solutions, and share insights with team members.

• Collaborate to design and build a centralized data platform utilized by teams throughout the organization.

• Construct scalable data integration mechanisms from diverse source systems.

• Develop shared platform components and standards.

• Ensure high standards of data quality, reliability, and consistency.

⛳️ Requirements

• Minimum of 3 years of experience as a Data Engineer or in a similar software engineering position.

• Proficiency in Python with the capability to write clean, testable production code.

• Practical experience with Apache Spark.

• Advanced SQL skills, including query optimization for large datasets.

• Strong comprehension of data warehouse design principles and data modeling.

• Hands-on knowledge of ETL/ELT processes.

• Familiarity with data quality, monitoring, and pipeline reliability.

• Experience with relational databases, including understanding their functionality, data modeling, and optimization.

• Knowledge of REST and gRPC standards for system integration.

• Experience with workflow orchestration tools (e.g., Airflow, Dagster, or similar).

• Understanding of CI/CD pipeline development and maintenance principles.

• Strong analytical problem-solving abilities and attention to detail.

• Effective communication skills and the capacity to collaborate within a team.

• Willingness to learn and explore new technologies and methodologies.

• Nice to have: Experience with dbt.

• Nice to have: Familiarity with Kafka, Pub/Sub, or other event streaming systems.

• Nice to have: Experience in building near-real-time / real-time pipelines.

• Nice to have: Background in working with Infrastructure-as-Code tools.

• Nice to have: Understanding of CDC (Change Data Capture) and data integration from transactional systems.

• Nice to have: Experience with Databricks or other lakehouse platforms.

🏝️ Benefits

• Significant influence on the growth of the company and its products.

• Work alongside an experienced team eager to share knowledge.

• Clear development vision supported by regular feedback and defined career paths.

• Frequent team-building events.

• A training budget for courses and conferences that interest you.

• An additional day off on your birthday.

• An extra day off for parents.

• Equipment tailored to your requirements.

• Private medical care and group insurance.

• Access to an e-learning platform for English learning and a benefits platform.

• Access to a wellbeing platform with opportunities for workshops and private therapy sessions.

• Flexibility to work remotely, from the office in Warsaw, or from a coworking space in your city.