Senior Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design and enhance Data Engineering solutions within the Google Cloud Platform (GCP) ecosystem.

• Manage the complete data lifecycle, from ingestion and processing to transformation, modeling, and data delivery.

• Construct and maintain dependable data pipelines.

• Create transformations utilizing BigQuery and Dataform or dbt.

• Automate workflows using Python.

• Contribute to data quality, governance, and organization efforts.

• Assist in the initial setup and parameterization of the solution.

• Engage in user and access management, maintain operational documentation, and collaborate with business teams.

• Develop, enhance, and support pipelines leveraging GCP services and tools.

• Construct and refine ETL/ELT processes.

• Design and maintain distributed processing jobs for large datasets.

• Implement and manage orchestration workflows utilizing Apache Airflow and Cloud Workflows.

• Create and maintain versioned data transformations and models with appropriate testing and documentation.

• Write Python scripts and automation solutions.

• Develop complex queries and enhance data manipulation using SQL.

• Identify and resolve issues related to pipeline performance, quality, and availability.

• Participate in code reviews, version control, and CI/CD processes.

• Collaborate with the team in an agile setting using Kanban.

⛳️ Requirements

• Significant experience as a Data Engineer on medium- to high-complexity projects.

• Practical experience with Google Cloud Platform (GCP).

• Proficiency in Python for developing solutions and automating processes.

• Advanced SQL capabilities and experience with data modeling and data warehousing.

• Experience in developing and maintaining ETL/ELT pipelines.

• Familiarity with data transformation tools such as Dataform or dbt.

• Experience in orchestrating pipelines using Apache Airflow and/or Cloud Workflows.

• Experience with distributed processing using technologies like Apache Spark, Dataproc, or similar.

• Experience with Git, GitLab, code versioning, and CI/CD methodologies.

• Understanding of software engineering best practices, monitoring, and error handling.

• Preferred: familiarity with Dataflow and Apache Beam.

• Preferred: experience with Lakehouse architecture.

• Preferred: Google Cloud certifications.

• Preferred: background in financial, accounting, or operational reconciliation processes.

• Preferred: knowledge of Data Reliability and data quality monitoring techniques.

• Preferred: experience managing large volumes of data.

• Preferred: experience with Kanbanize.

🏝️ Benefits

• Remote work — Monday to Friday, 9:00 a.m. to 6:00 p.m.

• Home office allowance — R$300.00 per month credited to an iFood card for meals and food expenses.

• Birthday benefit — gift voucher and one day off.

• Full access to RoxSchool, Alura, Pluralsight, and O’Reilly platforms for books and talks.

• Certification reimbursement of up to R$300.00 (Technology).

• R$300.00 bonus for each certification earned from these brands.

• Psychological support — two psychotherapy sessions per month funded by ROX.

• WellHub (Gympass) — partnership with gyms and health and wellness applications.

• Work equipment provided.