Data Engineer II

This is a fully remote position, open to applicants in Spain.

📋 Description

• Create and implement high-volume data processing pipelines utilizing Redshift, Athena, Iceberg, Spark, and Airflow.

• Establish monitoring, alerting mechanisms, and data quality assessments to maintain the reliability of pipelines and ensure data accuracy.

• Engage in architectural decision-making and technical design conversations for new data platform projects.

• Take part in code reviews and help uphold team standards related to data quality, testing, and documentation.

• Collaborate with data scientists, analysts, product managers, and various integration teams.

• Build jobs, libraries, and operations that support the work of data scientists and analysts.

⛳️ Requirements

• A Bachelor's degree in Computer Science or a related discipline, or equivalent experience.

• Over 5 years of professional experience in data engineering.

• Proficiency in SQL.

• Familiarity with databases like MySQL, Redshift, and Athena.

• Experience in data modeling.

• Knowledge of workflow orchestrators such as Dagster, Airflow, and Prefect.

• Experience in programming with Python.

• Excellent communication skills, both face-to-face and through virtual platforms.

• Understanding of ETL/ELT design patterns.

• Background in high-volume distributed data processing using Spark.

• Experience with AWS cloud services.

• A background check will be required.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Flexible working hours and remote work options.

• Opportunities for professional development and career advancement.

• Generous vacation and paid time off policies.