Senior Data Engineer

This is a fully remote position, open to applicants in Spain.

📋 Description

• Design and construct scalable data pipelines that gather data from external sources, process it, and load it into noSQL databases.

• Develop and enhance transformation logic to guarantee data quality, consistency, and schema alignment across diverse source systems.

• Analyze and comprehend external system interfaces to guide integration design and foresee upstream changes.

• Create and uphold document-oriented data models, ensuring alignment with current and future business needs.

• Generate and maintain visual representations of data models to foster cross-team collaboration and architectural documentation.

• Implement validation, monitoring, and alerting throughout the pipeline to ensure data integrity and enable early failure detection.

• Establish and enforce data governance protocols, including the management of sensitive data in accordance with compliance regulations.

• Develop and maintain strategies for anonymizing production data and synthesizing test data to facilitate safe, realistic testing environments.

• Write clean, well-tested, and maintainable code; review colleagues' contributions and uphold engineering standards within the team.

• Enhance pipeline performance for large-scale data processing, balancing throughput, latency, and costs.

• Collaborate closely with product management and engineering teams to convert business requirements into data pipeline solutions.

• Participate in architectural discussions and technical decision-making within Agile teams.

• Mentor junior team members and assist in refining development workflows and practices.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Data Engineering, or a related field.

• Over 5 years of experience in data engineering, emphasizing streaming and batch data pipelines.

• Strong expertise in Python and/or Kotlin/Java.

• Practical experience with streaming technologies (e.g., Kafka) and NoSQL databases (e.g., MongoDB or DocumentDB).

• Familiarity with AWS cloud services, including Lambda, GlueJobs, Eventbridge, S3, and CDK.

• Solid grasp of data modeling for document-oriented databases.

• Understanding of CI/CD pipelines and DevOps methodologies in a cloud-native setting.

• Experience in Agile/SAFe environments is an advantage.

• Excellent communication skills, comfortable engaging with both technical and non-technical stakeholders.

• Proficient in English; knowledge of Spanish and/or German is a plus.

🏝️ Benefits

• Fully remote work options, with the possibility to work from our office as needed.

• Access to professional development resources and complimentary language courses.

• Flexible working hours to cater to personal and professional obligations.

• A competitive holiday package along with access to various employee discounts.