Data Engineering Specialist

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Spearhead the development and enhancement of robust data pipelines utilizing Databricks, Azure Data Factory, Python, and PySpark to facilitate large-scale data initiatives.

• Architect and execute scalable solutions for the integration and processing of data from diverse sources, including transactional and operational datasets, while ensuring high standards of data quality and governance.

• Utilize SQL and Databricks to extract, transform, and prepare data, as well as to develop complex transformations that fulfill analytical and operational requirements.

• Collaborate with business and data teams to effectively translate technical requirements into impactful solutions that enhance logistics operations.

• Create and automate data ingestion, transformation, and analytical processes using tools such as Azure Data Factory, APIs, Kafka, and Oracle GoldenGate.

• Guide the optimization of data pipelines and advocate for high-performance data engineering practices, focusing on performance, scalability, and proactive monitoring.

• Maintain data quality and integrity through rigorous testing, validation, and governance, in partnership with BI and data science teams.

• Mentor junior data analysts and engineers, promoting team development and the adoption of data engineering best practices.

• Encourage innovation through the application of emerging technologies, such as machine learning and artificial intelligence, to implement predictive models and automation.

⛳️ Requirements

• A minimum of 4 years of experience in Data Engineering with a strong grasp of SQL, Databricks, Python, and PySpark.

• Proven experience in designing and implementing scalable and efficient data pipelines using Azure Data Factory or similar tools.

• Extensive knowledge of large-scale data processing, including experience with high data volumes and distributed architectures.

• Background in data integration and governance, ensuring data quality and reliability to inform business decisions.

• Exceptional analytical and problem-solving capabilities to tackle complex technical challenges.

• Ability to serve as a technical leader within the team, providing guidance on advanced technical solutions.

• Strong communication and interpersonal skills, enabling effective collaboration with various teams and stakeholders.

• Critical thinking and proactive approach to identifying and resolving technical and operational issues effectively.

• Preferred qualifications include:

• Familiarity with MicroStrategy and Power BI for collaboration with BI and analytics teams.

• Experience in real-time data ingestion systems, such as Kafka and API integrations.

• Exposure to cloud environments, particularly Azure.

• Knowledge of Machine Learning and AI models as they pertain to Data Engineering.

• Understanding of LLMs, AI agents, and Genies.

🏝️ Benefits

• Transportation voucher and/or shuttle service for roles at our distribution centers (DCs)*

• Meal voucher or food allowance

• Christmas gift basket voucher

• Home office allowance (for hybrid or remote employment contracts)*

• Multi-purpose purchase credit card

• Employee discount available at our stores

• Health insurance coverage

• Dr. Be (telemedicine, telepsychology, nutritional coaching, and sports coaching)

• Wellhub (Gympass)

• Programs and campaigns designed to promote the health and wellbeing of our employees and their families.

• Balance methodology implemented alongside leadership and teams to enhance communication, recognition, wellbeing, and work style/tools.

• Dental plan included

• Univers - discounts at Raia and Drogasil pharmacies

• Pet health plan available

• Running coaching services

• Discounts on universities, schools, language courses, and professional training

• Tickets to cinemas, parks, and more.

• We welcome applications from individuals with disabilities for all our opportunities.