Data Engineer, Contract

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Define the vision and roadmap for large-scale data architecture.

• Establish frameworks for governance, security, and regulatory compliance.

• Lead the strategic approach to platform selection, integration, and scaling.

• Assist organizations in the transition to a data lakehouse model.

• Facilitate technical discovery sessions.

• Convert complex architectures into clear, actionable insights.

• Ensure alignment of architectural recommendations with business growth and objectives.

• Design and implement modern data lakehouse architectures.

• Build and oversee ETL/ELT pipelines at scale.

• Implement monitoring for data quality, lineage tracking, and schema versioning.

• Develop data solutions that are cost-optimized, scalable, and compliant.

• Define and monitor success metrics.

⛳️ Requirements

• Over 10 years of experience in data engineering with enterprise-scale systems.

• Proficient in Apache Spark and Delta Lake.

• Extensive knowledge of Databricks.

• Proven experience in building scalable ETL/ELT pipelines using tools like Airflow.

• Advanced SQL skills for data modeling and transformation.

• Strong programming capabilities in Python (or Scala).

• Hands-on experience with data formats such as Parquet, Avro, and JSON.

• Familiarity with schema evolution, versioning, and backfilling techniques.

• Working knowledge of at least one major cloud platform.

• Experience in designing data architectures that incorporate real-time or streaming data.

• Consulting or client-facing experience is preferred.

• Familiarity with data mesh architectures and domain-driven data design.

• Knowledge of metadata management, data cataloging, and lineage tracking tools.

🏝️ Benefits

• Flexible working arrangements.

• Opportunities for professional development.