Data Engineer

This is a fully remote position, open to applicants in Portugal.

📋 Description

• Design, develop, implement, and maintain data engineering solutions.

• Build and optimize data pipelines.

• Ensure the quality and availability of information.

• Design, develop, and maintain ETL/ELT pipelines to integrate and transform large volumes of information.

• Implement processes for ingestion, cleansing, transformation, and storage within Data Lake and Data Warehouse architectures.

• Develop solutions using Python, Pandas, and PySpark.

• Manage and optimize environments in Azure Cloud, including Blob Storage and SQL Server.

• Develop and administer data solutions on Google Cloud Platform, particularly BigQuery.

• Create and optimize advanced SQL queries.

• Implement and manage workflows using Airflow or similar tools.

• Participate in the definition and implementation of data models.

• Apply best practices with Git/GitHub for version control.

• Collaborate in CI/CD processes to automate deployments and ensure software quality.

• Monitor, maintain, and optimize the performance of data processes and platforms.

• Engage in data migration projects and platform modernization.

• Work collaboratively with Analytics, Data Science, BI, and business areas to translate requirements into scalable solutions.

• Explore and incorporate tools related to Agentic Engineering and Artificial Intelligence.

⛳️ Requirements

• 3 to 5 years of experience as a Data Engineer.

• 1 to 2 years of experience in Walmart Cloud - WCNP (preferred).

• 3 to 5 years of experience developing with Python (Pandas, PySpark, or equivalent).

• 2 years or more of experience in Azure Cloud (Blob Storage and SQL Server).

• 2 years or more of experience in Google Cloud Platform (BigQuery).

• 2 years or more of experience with Airflow or similar orchestration tools.

• 2 years or more of experience in developing and maintaining ETL/ELT pipelines.

• Experience in CI/CD processes.

• Experience in data modeling.

• Experience working with Git/GitHub.

• Experience in data migration projects (preferred).

• Experience using Agentic Engineering tools (preferred).

• Proficiency in Python (Pandas, PySpark).

• Advanced SQL skills.

• Knowledge of Azure Cloud (Blob Storage, SQL Server).

• Familiarity with Google Cloud Platform (BigQuery).

• Experience with Apache Airflow or similar orchestration tools.

• Knowledge of Data Modeling.

• Understanding of Data Lake and Data Warehouse architectures.

• Proficient in Git/GitHub.

• Knowledge of ETL/ELT processes.

• Experience with CI/CD practices.

• Intermediate English skills (technical reading and comprehension of specialized documentation).

• Certifications in Azure, Google Cloud, or data technologies (preferred).

• Familiarity with Agile methodologies (Scrum/Kanban) (preferred).

• Experience in enterprise data ecosystems in retail and consumer goods (preferred).

• Experience with Walmart Cloud Native Platform (WCNP) (preferred).

🏝️ Benefits

• Continuous training programs and certifications.

• Access to learning platforms and professional development.

• Culture of innovation and collaboration.

• Physical and emotional wellness programs.

• Opportunities for growth in international projects.

• Recognition and rewards for performance.

• Benefits that exceed legal requirements.

• Life insurance.

• Major Medical Expenses Insurance.

• Grocery vouchers.

• 100% payroll scheme.