Data Engineer

This is a fully remote position, open to applicants in Poland.

📋 Description

• Implement, maintain, and provide support for MS SQL Server data warehouse and SSIS processes and jobs on a daily basis.

• Design, construct, and uphold scalable data processing pipelines utilizing SQL, Python, and Apache Spark/PySpark.

• Work with raw data and devise methods for its integration into the data platform.

• Develop CI/CD pipelines for data engineering solutions.

• Create and maintain Infrastructure as Code solutions.

• Integrate the data platform with various systems and applications.

• Engage in architectural decision-making and establish engineering standards.

• Conduct code reviews, document solutions, and disseminate knowledge among team members.

• Collaborate to create and develop a centralized data platform utilized by teams across the organization.

• Construct scalable data integration mechanisms from diverse source systems.

• Ensure high standards of data quality, reliability, and consistency.

⛳️ Requirements

• Minimum of 3 years of experience as a Data Engineer or in a comparable software engineering role.

• At least 1 year of experience with MS SQL Server, SSIS, and SQL Server Agent technologies, including the deployment of new features.

• Capability to analyze existing legacy code for enhancements and transition to newer technology.

• Willingness to participate in a Databricks-oriented project during the collaboration.

• Proficiency in Python and the ability to write clean, testable production code.

• Hands-on experience with Apache Spark.

• Advanced SQL skills, including query optimization on large datasets.

• Strong comprehension of data warehouse design principles and data modeling.

• Practical experience with ETL/ELT processes.

• Familiarity with data quality, monitoring, and pipeline reliability.

• Experience with relational databases, including data modeling and optimization.

• Understanding of REST and gRPC standards for system integration.

• Experience with workflow orchestration tools such as Airflow or Dagster.

• Knowledge of CI/CD pipeline construction and maintenance principles.

• Strong analytical problem-solving abilities and attention to detail.

• Effective communication skills and the ability to work collaboratively in a team.

• Openness to learning and exploring new technologies and methodologies.

🏝️ Benefits

• Genuine influence on the development of both the company and the product.

• Collaborate within a seasoned team that is eager to share its expertise.

• Clear developmental vision supported by regular feedback and well-defined career paths.

• Regular team-building events.

• A training budget for courses and conferences that interest you.

• An additional day off on your birthday.

• An extra day off for parents.

• Customized equipment tailored to your needs.

• Private medical care and group insurance.

• Access to an e-learning platform for English language learning and a benefits platform.

• Access to a wellbeing platform, with opportunities for workshops and private therapy sessions.

• Flexibility to work remotely, from the Warsaw office, or from a coworking space in your city.