Senior Data Developer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Develop and manage pipelines that connect and drain data between the CRM, Data Lake, and Adobe Experience Platform (AEP).

• Create and execute ETL/ELT pipelines for the integration of CRM, Data Lake, and AEP, encompassing both batch and streaming data ingestion as well as profile, segment, and event exports.

• Design analytical tables within the Databricks Data Lake, calculating engagement and business metrics.

• Ensure data quality through comprehensive testing, alert systems, source reconciliation, and handling of identity deduplication.

• Adhere to LGPD requirements by implementing data classification, pseudonymization, retention and deletion policies, audit trails, and responding to data subject requests.

• Assist the architect with XDM modeling and identity strategy from the perspective of source data.

• Maintain documentation for pipelines, data dictionaries, and lineage; oversee operational runbooks.

• Manage production pipelines and address data incidents as they arise.

• Provide monitoring solutions, uphold agreed update SLAs, track error rates, and ensure reproducible activation indicators are aligned with CJA.

⛳️ Requirements

• Proven experience in data engineering, particularly with production pipelines.

• Proficient in SQL, Python, and Databricks (including Spark, Delta Lake, jobs, and workflows).

• Experience with CRM and Data Lake integration through APIs, connectors, and file transfers.

• Knowledge of data quality processes, including automated testing, monitoring, and reconciliation.

• Familiarity with metric calculation and governance, covering definition, versioning, and reconciliation with analytical tools.

• Understanding of LGPD as it relates to personal data, including minimization, pseudonymization, retention, and data subject rights.

• Fluent in Portuguese.

• Advanced proficiency in English for technical documentation purposes.

• Experience with Veeva is highly preferred.

• Familiarity with AEP concerning data ingestion and export processes.

• Possession of Databricks or Adobe certifications.

• Background in the pharmaceutical or healthcare industries.

• Experience with orchestration tools such as Airflow or Databricks Workflows.

• Knowledge of infrastructure as code principles.

• Expertise in data modeling for personalization and recommendation systems.

🏝️ Benefits

• Health and dental insurance.

• Meal and food allowances.

• Childcare support.

• Extended paternity leave.

• Access to gym partnerships and health and wellness professionals through Wellhub (Gympass) TotalPass.

• Profit Sharing and Results Participation (PLR).

• Life insurance coverage.

• Continuous learning opportunities via CI&T University.

• Membership in a discount club.

• Free online resources dedicated to physical, mental, and overall well-being.

• Courses on pregnancy and responsible parenting.

• Collaborations with online educational platforms.

• Access to a language learning platform.

• Support for inclusion and workplace accommodations for individuals with disabilities.

• A dedicated Health and Well-being team, inclusion specialists, and affinity groups.