Data Engineer

This is a fully remote position, open to applicants in Mexico, +1 more country.

📋 Description

• Develop and sustain essential data infrastructure to facilitate decision-making across the company.

• Ingest, transform, and model data effectively.

• Manage a centralized data warehouse that ensures data is clean, reliable, and easily accessible.

• Design, create, and maintain scalable data pipelines utilizing Python and Airflow.

• Work alongside Analytics Engineers and other team members to provide well-structured data.

• Implement monitoring, logging, and alerting systems to ensure pipeline reliability and performance.

• Maintain data quality and integrity through validation frameworks and rigorous testing.

• Enhance performance and cost-effectiveness of cloud-based data systems.

• Participate in architectural decisions related to data storage, workflow orchestration, and infrastructure as code.

• Document the processes and pipelines related to data management.

⛳️ Requirements

• Bachelor’s degree in computer science or a related discipline.

• Several years of experience in a Data Engineering or Software Engineering position.

• Strong proficiency in Python along with experience in SQL.

• Familiarity with Kubernetes and containerization technologies.

• Experience with Airflow or comparable process orchestration tools.

• Knowledge of contemporary data file formats such as Parquet, ORC, and JSON.

• Experience in data architecture, modeling, and pipelines within an enterprise data warehouse (e.g., Snowflake, Redshift, BigQuery).

• Proficiency with AWS services (S3, Lambda, Athena).

• Ability to function independently as well as collaboratively in a team-oriented setting.

• Strong analytical capabilities coupled with a critical thinking approach.

• Proven track record as a software or data engineer.

• Solid understanding of principles in data architecture and engineering.

• Excellent written and verbal communication skills.

• Commitment to upholding YouGov's values.

• Preferred: experience using a data transformation tool like DBT.

• Preferred: experience with NoSQL and Graph Database technologies.

• Preferred: familiarity with data reporting tools (Power BI, Tableau, Apache Superset).

• Preferred: experience with R programming language.

🏝️ Benefits

• Comprehensive benefits that promote physical, financial, and emotional wellbeing.

• A supportive work environment that values belonging and individuality.

• Commitment to equal opportunity employment.