AI Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Create enterprise data models utilizing dimensional modeling, Data Vault 2.0, or comparable methodologies.

• Design and sustain data warehouses, data lakes, and lakehouse architectures.

• Establish and uphold data standards, naming conventions, and schema governance across various domains.

• Execute data governance frameworks, which include cataloging, lineage tracking, and metadata management.

• Develop automated data quality checks, validation rules, and anomaly detection mechanisms within data pipelines.

• Ensure adherence to data privacy regulations through the implementation of access controls and data classification protocols.

• Construct and manage batch and streaming data pipelines, ensuring full observability and alert notifications.

• Implement change data capture methodologies, real-time data ingestion, and ELT/ETL frameworks.

• Manage and scale cloud data platforms while optimizing storage, computational resources, and cost effectiveness.

• Collaborate with analytics engineers, data scientists, and BI teams to deliver reliable data products.

• Define data contracts between data producers and consumers; mentor junior engineers.

⛳️ Requirements

• Over 5 years of data engineering experience, with a concentration on enterprise data platforms.

• Proficient in SQL; strong skills in Python for data processing and automation tasks.

• Extensive experience with cloud-based data warehouse platforms.

• Practical experience with data transformation frameworks and workflow orchestration tools.

• Familiarity with data governance and cataloging tools.

• A solid grasp of data quality frameworks, privacy laws, and CI/CD processes for pipelines.

🏝️ Benefits

• To be agreed upon.