Junior Data Engineer – Mobile Apps

This is a fully remote position, open to applicants in Spain.

📋 Description

• Design, develop, and enhance data infrastructure on Databricks.

• Architect data pipelines utilizing BigQuery, Google Cloud Storage, Apache Airflow, dbt, Dataflow, and Pub/Sub.

• Assist in the creation and upkeep of a data platform on GCP, including data warehousing with BigQuery/Databricks.

• Structure data into well-defined layers and domain-specific Data Marts for analytics and reporting purposes.

• Aid in Terraform-based Infrastructure as Code for the provisioning and management of cloud resources.

• Construct, sustain, and optimize ETL/ELT pipelines with Apache Airflow.

• Develop and manage dbt transformations within BigQuery.

• Facilitate data ingestion and processing utilizing Google Dataflow, Apache Beam, or Pub/Sub.

• Monitor scheduled tasks and resolve any failures that arise.

• Implement and uphold data quality checks through Great Expectations or dbt tests.

• Support the documentation of datasets, metadata, lineage, and auditing processes.

• Adhere to security best practices, including IAM, encryption, and data handling procedures.

• Collaborate with Analytics, Product, and Data Science teams for data support.

⛳️ Requirements

• Over 1 year of experience in data engineering or a related field.

• Familiarity with mobile, product, or marketing data is advantageous.

• Basic hands-on experience with GCP services like BigQuery and Google Cloud Storage.

• Understanding of Apache Airflow for scheduling and orchestrating data workflows.

• Some experience with dbt or comparable transformation tools.

• Exposure to Pub/Sub, Dataflow, or other batch/streaming tools is a plus.

• Comprehension of Data Mart concepts and interest in Infrastructure as Code tools like Terraform.

• Proficient coding skills in Python; knowledge of Java or Scala is a benefit.

• Capability to write scripts for automation and data processing tasks.

• Familiarity with Docker and fundamental container concepts.

• Exposure to CI/CD and version control systems such as GitHub Actions, GitLab CI, Jenkins, or similar.

• Understanding of data quality principles and experience with dbt tests, Great Expectations, or similar tools is advantageous.

• Basic knowledge of data governance principles such as lineage, metadata, and access control.

• Awareness of privacy and compliance principles, such as GDPR, is a plus.

• General understanding of OLTP and OLAP systems.

• Excellent communication abilities and a willingness to collaborate with both technical and non-technical stakeholders.

• Organized, proactive, and eager to learn.

• Strong problem-solving skills and attention to detail.

• Interest in machine learning workflows and familiarity with tools like Vertex AI or similar ML platforms.

🏝️ Benefits

• Opportunities for growth and career development.

• Emphasis on work-life balance.

• Comprehensive benefits package.

• Unique perks offered.

• Equal Employment Opportunity Employer.