Senior Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Oversee intricate data engineering initiatives spanning various business sectors, source systems, domains, or stakeholder groups.

• Establish data engineering methodologies that correspond with business requirements, source system realities, platform limitations, transformation patterns, and downstream consumption needs.

• Convert ambiguous stakeholder requests into organized pipeline strategies, ingestion models, transformation designs, curated data layers, and actionable insights.

• Direct the design and execution of scalable ingestion, transformation, and serving patterns across cloud warehouses, lakehouses, and analytical environments.

• Set and promote best practices for schema design, pipeline modularity, layered data architecture, data validation, lineage awareness, scheduling discipline, error management, and sustainable engineering patterns.

• Create and enhance reusable data engineering workflows that facilitate reporting, dashboarding, data science, AI workflows, and agentic applications.

• Assist in team staffing, task allocation, prioritization, and ensuring delivery quality across data engineering projects.

• Supervise, mentor, and develop team members through feedback, guidance, and performance support.

• Evaluate deliverables for clarity, technical rigor, quality, consistency, and business applicability.

• Aid teams in enhancing data quality, minimizing pipeline fragility, reinforcing source alignment, and boosting trust in downstream governed datasets.

• Support data engineering patterns that enhance AI and agentic readiness, including metadata-rich datasets, retrieval-supportive organization, document and chunk preparation support, governed access paths, and scalable data availability for downstream workflows.

• Collaborate with Analytics Engineers, Data Analysts, Data Scientists, AI Scientists, AI Engineers, AI Platform Engineers, and Architects to align data foundations with downstream analytical, AI, and platform requirements.

• Participate in hiring, onboarding, capability enhancement, and team maturity within the data engineering discipline.

• Adhere to established governance, privacy, security, and data quality standards across the team's work.

⛳️ Requirements

• Over 5 years of experience in data engineering.

• Extensive knowledge of data engineering, cloud-based data platforms, and scalable pipeline design.

• Demonstrated ability to define data engineering strategies in complex business settings with multiple systems, domains, and downstream consumers.

• Strong leadership abilities, including coaching, feedback, prioritization, and support for team development.

• Comprehensive understanding of ETL and ELT concepts, schema evolution, orchestration, dependency management, layered data design, and downstream data consumption requirements.

• Proficient in SQL, Python, Spark, PySpark, and cloud-native data engineering workflows.

• Solid grasp of medallion, lakehouse, warehouse, or layered architectural patterns and their significance in governed data reuse.

• Exceptional analytical and problem-solving skills regarding data quality issues, performance challenges, dependency risks, and transformation design.

• Practical understanding of how reliable data foundations facilitate machine learning, AI workflows, retrieval quality, agentic systems, and governed application behavior.

• Strong stakeholder management abilities and the capacity to communicate effectively with both technical and non-technical audiences.

• Ability to balance delivery quality, team workload, business urgency, and stakeholder expectations across various workstreams.

• Proficient written and verbal communication skills in English, with confidence in client-facing and leadership-facing situations.

• Capable of collaborating effectively across distributed teams in the Americas and across multiple disciplines.

• Upper-intermediate level of English proficiency.

• Technical expertise in Microsoft Fabric, Microsoft Foundry, APIM Gateway, Application Insights, and Cosmos DB.

🏝️ Benefits

• Flexible work options, including remote and hybrid arrangements (depending on the country).

• Opportunities for career advancement, including international mobility and professional development programs.

• Access to learning and development resources, with cutting-edge tools, training, and industry expert insights.