Senior Engenheiro de Dados – DBT

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Continuously monitor data pipelines (both batch and on-demand)

• Address operational failures and critical incidents

• Conduct log analysis and troubleshooting within Dataproc, pipelines, and DAGs

• Oversee data loads, reprocessings, and validations

• Maintain communication with Engineering, Architecture, Governance, and Business teams

• Support the stabilization of environments and continuous improvement efforts

• Document incidents, root causes, and action plans

⛳️ Requirements

• Proven experience with Google Cloud Platform (GCP)

• Proficiency in BigQuery, including data modeling, performance optimization, and cost control

• Experience with Dataproc / Apache Spark

• Involvement in batch data pipelines, including monitoring and reprocessing

• Ability to analyze logs, identify, and address failures in data pipelines

• Knowledge of IAM (Identity and Access Management) and permission management within GCP

• Experience in regulated, critical, or high-availability environments

• Familiarity with Continuous Query, focusing on continuous data processing and incremental updates (streaming or near real-time)

• Experience with Pub/Sub, including integration, monitoring, and operation of event-driven pipelines and messaging

• Knowledge of Cloud SQL (MySQL) for operation, support, and analysis of data in managed relational databases

• Experience with Cloud Functions, focusing on support and maintenance of event-driven serverless functions

• Work with Cloud Run, including operation and monitoring of containerized applications in serverless environments

• Experience with Cloud Composer (Apache Airflow), overseeing monitoring, analysis, and support for DAGs, including failures, reprocessings, and dependencies

• Knowledge of MongoDB, focusing on queries, data analysis, and support for NoSQL databases

• Practical experience with agile methodologies (Scrum, Kanban, or similar)

• Experience in projects related to Open Finance

• Knowledge or experience with DBT (Data Build Tool)

🏝️ Benefits

• Remote work – Monday to Friday, (9 AM to 6 PM)

• Home office assistance – Ifood meal/food allowance of R$ 300.00 per month

• Birthday – A special day celebrated with a gift voucher and a Day off for you to enjoy your day

• Courses – Full access to RoxSchool, Alura, Pluralsight, Oreilly for books and talks, and RoxSchool

• Certifications – Reimbursement for certifications up to R$300.00 (TECHNOLOGY) + Bonus of R$300.00 for each certification achieved from these Brands

• Psychological support – Two therapy sessions covered by ROX monthly with partner psychologists

• WellHub (Gympass) – Partnership with gyms and health and wellness apps

• We provide work equipment