Data Engineer

This is a fully remote position, open to applicants in Mexico, +1 more country.

📋 Description

• Design, create, and sustain robust and scalable data pipelines utilizing Python and Airflow.

• Work alongside Analytics Engineers and team members to provide clean, well-structured data to downstream users.

• Implement monitoring, logging, and alerting systems to ensure data pipeline reliability and performance.

• Maintain data quality and integrity through validation frameworks and testing procedures.

• Enhance the performance and cost-effectiveness of cloud-based data systems.

• Participate in architectural decisions regarding data storage, workflow orchestration, and infrastructure as code.

• Document data pipelines and associated processes comprehensively.

• Convert raw datasets into actionable data for analysts and data scientists.

• Remain updated with industry tools and best practices.

⛳️ Requirements

• Bachelor’s degree in computer science or a related field.

• Several years of proven experience in a Data Engineering or Software Engineering capacity.

• Strong proficiency in Python and familiarity with SQL.

• Experience with Kubernetes and containerization technologies.

• Proficient in using Airflow or a similar process orchestration tool.

• Knowledge of modern data file formats such as Parquet, ORC, and JSON.

• Experience with data architecture, modeling, and pipelines within an enterprise data warehouse (e.g., Snowflake, Redshift, BigQuery).

• Familiarity with AWS products including S3, Lambda, and Athena.

• Ability to work autonomously as well as collaboratively in a team-oriented setting.

• Strong analytical capabilities and critical thinking skills.

• Proven experience as a software or data engineer.

• Good understanding of data architecture and engineering principles.

• Excellent written and verbal communication skills.

• Commitment to YouGov values.

• Preferred: experience with a data transformation tool such as DBT.

• Preferred: experience with NoSQL and Graph Database technologies.

• Preferred: familiarity with data reporting software (e.g., Power BI, Tableau, Apache Superset).

• Preferred: experience with R.

🏝️ Benefits

• Comprehensive benefits package supporting physical, financial, and emotional wellbeing.

• A supportive workplace that fosters belonging and values uniqueness.

• Commitment to equal opportunity employment.