Senior Data Engineer

Posted 1 day ago

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design, develop, maintain, and enhance data pipelines for batch processes and, when relevant, near-real-time processing.

• Construct scalable, resilient, and secure data architectures and structures that align with business requirements.

• Develop and refine ETL/ELT processes, ensuring efficiency, traceability, reprocessing capabilities, and cost management.

• Collaborate with Product, Technology, Data, and executive teams to convert business requirements into technical solutions.

• Establish and implement data modeling best practices, encompassing dimensional models, facts, dimensions, granularity, and business rules.

• Detect and address performance challenges in queries, pipelines, data loads, and storage structures.

• Enforce controls for data quality, consistency, completeness, uniqueness, timeliness, and integrity.

• Develop and sustain monitoring systems, alerts, and operational metrics to oversee the health of pipelines and databases.

• Document architectures, data flows, contracts, dependencies, business rules, and operational procedures.

• Act as a technical resource, conducting reviews and ensuring the quality of the team’s outputs.

• Perform code reviews, suggest architectural enhancements, and advocate for best practices in development, version control, and continuous delivery.

• Assist in technical decisions regarding the advancement of the data platform, security, governance, reliability, and observability.


⛳️ Requirements

• Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related discipline.

• Extensive experience in Data Engineering, pipeline development, and constructing solutions in production settings.

• Advanced skills in SQL, including writing, analyzing, and optimizing complex queries.

• Experience in building, maintaining, and optimizing ETL/ELT processes.

• Proficiency in relational and dimensional data modeling, covering facts, dimensions, granularity, and keys.

• Experience with query optimization, execution plan analysis, partitioning, distribution, and data-loading approaches.

• Practical knowledge of AWS services, particularly Amazon S3 and related data storage, processing, and integration services.

• Familiarity with Apache Airflow for workflow orchestration, scheduling, and monitoring.

• Knowledge of Git and Jenkins, encompassing version control, code review, and continuous integration or delivery.

• Understanding of data and pipeline quality, observability, and monitoring.

• Experience in defining data models, metrics, KPIs, reports, and dashboards.

• Preferred: Familiarity with Amazon Redshift architecture and optimization.

• Preferred: Knowledge of Python applied to Data Engineering.

• Preferred: Understanding of Power BI and best practices for presenting metrics.

• Preferred: Basic knowledge of or experience with Apache Kafka and streaming concepts.

• Preferred: Insight into data governance, cataloging, lineage, security, and data access control.

• Preferred: Awareness of DataOps practices, automated testing, and observability.


🏝️ Benefits

• Meal and/or food allowance.

• Health and dental insurance.

• Life insurance.

• Partnerships with TotalPass and ZenKlub.

• Extended maternity and paternity leave.

• Childcare assistance.

• Discounts of up to 50% on graduate and MBA programs at leading institutions such as FIA, FAAP, and PUCRS.

• No dress code: what matters is wearing what makes you feel comfortable.

• #TáDeParabéns: A day off on your birthday.

• Baby Gift: A gift for newborns.

People also viewed

Trax Technologies8 hours ago

Data Architect

US flagUnited States OnlyFull-timeData Engineer
ApplyView job
Fiserv8 hours ago

Senior Snowflake Data Platform and Artificial Intelligence Architect

US flagUnited States OnlyFull-timeData Engineer
ApplyView job
Ontrac Solutions8 hours ago

Staff Data Engineer

US flagUnited States OnlyFreelanceData Engineer
ApplyView job
General Dynamics Information Technology8 hours ago

ICAM Identity Data Management Engineer – Radiant Logic

US flagUnited States OnlyFull-timeData Engineer$170k – $230k/year
ApplyView job
General Dynamics Information Technology8 hours ago

Identity Data Management Engineer – Radiant Logic

US flagUnited States OnlyFull-timeData Engineer$170k – $230k/year
ApplyView job
General Dynamics Information Technology8 hours ago

Senior Data Engineer

US flagUnited States OnlyFull-timeData Engineer$102k – $138k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers