Data Engineering Specialist

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Take full ownership of data domains from source ingestion to the layers utilized daily by the business for making purchasing, pricing, inventory, and assortment decisions.

• Develop and enhance comprehensive ELT/ETL ingestion and transformation pipelines, both in batch and near real-time, leveraging data from SAP, Oracle, PostgreSQL, APIs, and files.

• Manage workloads in Cloud Composer (Airflow), ensuring adherence to SLAs, idempotency, reprocessing, and effective monitoring.

• Design the data warehouse in BigQuery employing a Medallion architecture—bronze, silver, and gold—with Dataform, delivering dependable, high-performance models for use in Power BI.

• Execute and maintain CDC replication for transactional databases (using Datastream and similar tools).

• Handle large data volumes with PySpark (Dataproc) and Apache Beam (Dataflow) as dictated by use cases.

• Enhance BigQuery performance and manage costs through techniques such as partitioning, clustering, query rewriting, and data FinOps.

• Establish technical standards, conduct code reviews, and act as a technical authority for the data team.

• Convert business requirements from Commercial, Supply Chain, Finance, and Marketing into effective data solutions.

⛳️ Requirements

• Bachelor’s degree in Education, Psychology, Business Administration, or a related discipline;

• A minimum of 5 years of robust experience as a Data Engineer, showcasing senior-level capabilities;

• Proficient SQL skills required, including window functions, CTEs, query optimization, and analysis of execution plans;

• Experience in applying Python to data engineering is essential, including modular, tested, and version-controlled coding practices;

• Proven experience in constructing end-to-end ELT/ETL pipelines, encompassing failure handling, reprocessing, and ensuring idempotency;

• Familiarity with Airflow (or Cloud Composer) in a live production setting;

• Experience with public cloud platforms in a production data environment;

• Familiarity with cloud data warehouses—preferably BigQuery; knowledge of Snowflake, Redshift, or Synapse is also acceptable;

• Experience with data modeling and layered architectures (Medallion/dimensional);

• Strong understanding of relational databases: PostgreSQL, Oracle, SQL Server, or MySQL;

• Experience with file formats (Parquet, CSV, JSON, Avro) and interfacing with REST APIs;

• Preferred experience with Git, including branch management, pull requests, and code review processes.

🏝️ Benefits

• Medical insurance

• Dental insurance

• Life insurance

• Meal and/or food allowance

• Grocery allowance

• Transportation allowance

• Childcare assistance

• Annual bonus based on individual and company performance

• TotalPass

• Petlove plan

• Birthday day off

• Discounts at our stores

• Career development plan

• Partnerships offering discounts on courses and degree programs