
Senior Data Engineer
Posted 1 day ago

Posted 1 day ago
This is a fully remote position, open to applicants in Brazil.
• Design, develop, maintain, and enhance data pipelines for batch processes and, when relevant, near-real-time processing.
• Construct scalable, resilient, and secure data architectures and structures that align with business requirements.
• Develop and refine ETL/ELT processes, ensuring efficiency, traceability, reprocessing capabilities, and cost management.
• Collaborate with Product, Technology, Data, and executive teams to convert business requirements into technical solutions.
• Establish and implement data modeling best practices, encompassing dimensional models, facts, dimensions, granularity, and business rules.
• Detect and address performance challenges in queries, pipelines, data loads, and storage structures.
• Enforce controls for data quality, consistency, completeness, uniqueness, timeliness, and integrity.
• Develop and sustain monitoring systems, alerts, and operational metrics to oversee the health of pipelines and databases.
• Document architectures, data flows, contracts, dependencies, business rules, and operational procedures.
• Act as a technical resource, conducting reviews and ensuring the quality of the team’s outputs.
• Perform code reviews, suggest architectural enhancements, and advocate for best practices in development, version control, and continuous delivery.
• Assist in technical decisions regarding the advancement of the data platform, security, governance, reliability, and observability.
• Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related discipline.
• Extensive experience in Data Engineering, pipeline development, and constructing solutions in production settings.
• Advanced skills in SQL, including writing, analyzing, and optimizing complex queries.
• Experience in building, maintaining, and optimizing ETL/ELT processes.
• Proficiency in relational and dimensional data modeling, covering facts, dimensions, granularity, and keys.
• Experience with query optimization, execution plan analysis, partitioning, distribution, and data-loading approaches.
• Practical knowledge of AWS services, particularly Amazon S3 and related data storage, processing, and integration services.
• Familiarity with Apache Airflow for workflow orchestration, scheduling, and monitoring.
• Knowledge of Git and Jenkins, encompassing version control, code review, and continuous integration or delivery.
• Understanding of data and pipeline quality, observability, and monitoring.
• Experience in defining data models, metrics, KPIs, reports, and dashboards.
• Preferred: Familiarity with Amazon Redshift architecture and optimization.
• Preferred: Knowledge of Python applied to Data Engineering.
• Preferred: Understanding of Power BI and best practices for presenting metrics.
• Preferred: Basic knowledge of or experience with Apache Kafka and streaming concepts.
• Preferred: Insight into data governance, cataloging, lineage, security, and data access control.
• Preferred: Awareness of DataOps practices, automated testing, and observability.
• Meal and/or food allowance.
• Health and dental insurance.
• Life insurance.
• Partnerships with TotalPass and ZenKlub.
• Extended maternity and paternity leave.
• Childcare assistance.
• Discounts of up to 50% on graduate and MBA programs at leading institutions such as FIA, FAAP, and PUCRS.
• No dress code: what matters is wearing what makes you feel comfortable.
• #TáDeParabéns: A day off on your birthday.
• Baby Gift: A gift for newborns.
Trax Technologies
Fiserv
Ontrac Solutions
General Dynamics Information Technology
Get handpicked remote jobs straight to your inbox weekly.