Senior Data Engineer – DBT

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Continuously oversee batch, streaming, and on-demand data pipelines to guarantee their availability and maintain data quality.

• Identify, analyze, and address operational incidents and critical failures within data environments.

• Execute advanced troubleshooting by examining logs, metrics, and alerts on Google Cloud Platform (GCP).

• Monitor and assist data workflows, including Directed Acyclic Graphs (DAGs), reprocessing, dependencies, and load validations.

• Track the execution of processes in Dataproc, Spark, BigQuery, and other components of the data architecture.

• Work collaboratively with Data Engineering, Architecture, Governance, and Business teams to resolve issues and promote continuous improvements.

• Contribute to the stability, reliability, and advancement of data environments.

• Prepare and maintain documentation for incidents, root cause analyses (RCA), operational procedures, and action plans.

• Engage in initiatives focused on automation, observability, and the optimization of operational processes.

⛳️ Requirements

• Demonstrated experience with Google Cloud Platform (GCP);

• In-depth expertise in BigQuery, including data modeling, performance optimization, and cost management;

• Experience with Dataproc / Apache Spark;

• Familiarity with batch data pipelines, including monitoring and reprocessing;

• Capability to analyze logs, identify, and address failures in data pipelines;

• Understanding of IAM (Identity and Access Management) and permission management on GCP;

• Experience in regulated, critical, or high-availability environments;

• Knowledge of Continuous Query, emphasizing continuous data processing and incremental updates (streaming or near real-time);

• Proficiency with Pub/Sub, including integration, monitoring, and operation of event-driven and messaging pipelines;

• Understanding of Cloud SQL (MySQL) for operation, support, and data analysis in managed relational databases;

• Experience with Cloud Functions, providing support and maintenance for event-driven serverless functions;

• Knowledge of Cloud Run, including the operation and monitoring of containerized applications in serverless environments;

• Experience with Cloud Composer (Apache Airflow), monitoring, analyzing, and supporting DAGs, including handling failures, reprocessing, and managing dependencies;

• Familiarity with MongoDB, focusing on queries, data analysis, and support for NoSQL databases;

• Practical experience with agile methodologies (Scrum, Kanban, or similar).

🏝️ Benefits

• Remote work – Monday to Friday (09:00–18:00);

• Home-office allowance – Meal/food credit on an iFood card of R$ 300.00 per month;

• Birthday – On your special day, Rox provides a gift card and a day off for celebration;

• Courses – Full access to RoxSchool, Alura, Pluralsight, and O'Reilly (books and talks);

• Certifications – Certification reimbursement up to R$ 300.00 (TECHNOLOGY) plus a R$ 300.00 bonus per certification achieved from these brands;

• Mental health support – Two psychotherapy sessions per month covered by ROX with partner psychologists;

• WellHub (Gympass) – Partnership with gyms and health & wellness apps;

• Company-provided work equipment.