Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design and optimize data ingestion and transformation pipelines within Databricks.

• Revamp data marts and data lake layers that support CRM and CDP platforms.

• Develop and manage ETL/ELT jobs utilizing Spark, SQL, and Delta Lake.

• Connect Databricks with Salesforce Data Cloud for efficient data ingestion, export, and synchronization.

• Engage in technical discovery, analyzing the existing architecture (As-Is) and crafting the future architecture (To-Be).

• Guarantee data governance, quality, performance, and cost control during processing.

• Maintain documentation for architecture, pipelines, and technical decisions.

• Collaborate with specialists in Data Cloud and Marketing Cloud on defining data models.

⛳️ Requirements

• Bachelor's degree in Computer Science, Engineering, Information Systems, Statistics, or related disciplines.

• Demonstrated experience with Databricks in a production setting, including Spark, Delta Lake, notebooks, and jobs/workflows.

• Proficient in advanced SQL.

• Experience with Python for data pipeline development.

• Familiarity with data lake or lakehouse architectures.

• Fluent in Portuguese.

• Intermediate proficiency in English for technical documentation and participation in meetings.

• Understanding of PySpark and Spark SQL.

• Knowledge of Databricks, Workflows, Delta Lake, and Unity Catalog.

• Experience with Python for data engineering tasks.

• Skills in dimensional and analytical data modeling.

• Experience in orchestrating pipelines using Airflow, Azure Data Factory, or similar tools.

• Awareness of best practices in data governance and data quality.

• Differentiators: Databricks certification, experience with Salesforce Data Cloud or other CDP platforms, expertise in Identity Resolution, customer data unification, consulting project experience, and advanced English proficiency.

🏝️ Benefits

• Meal and food allowance.

• Home office allowance.

• Profit sharing/results participation program.

• Support for obtaining certifications.

• Health insurance with co-payment options.

• Life insurance coverage.

• Childcare assistance.

• Day off for birthdays.

• Zenklub (mental health support services).

• Extended maternity/paternity leave.

• Talkers program (support for English language learning).

• Discounts available for MBA and postgraduate courses.

• Optional dental plan (employee-paid).

• Optional Total Pass (employee-paid).

• Partnership with Sesc.