Senior Data Engineer, GCP, Databricks

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design, implement, and enhance scalable data pipelines within a GCP environment.

• Create processes for data ingestion, transformation, and delivery utilizing GCP architectures.

• Establish technical standards, best practices, and reusable frameworks for data engineering.

• Ensure the performance, reliability, observability, and scalability of solutions.

• Develop and sustain analytical data models.

• Automate processes for data integration and transformation.

• Guarantee solution SLAs and availability.

• Discover opportunities for cost optimization within GCP.

• Assist in data platform migration and modernization efforts.

• Construct and enhance solutions with BigQuery, Dataform, Cloud Storage, Pub/Sub, Cloud Composer/Airflow, Dataflow, Cloud Functions, Cloud Run, Looker, and integrated BI tools.

• Implement processes for Data Quality, Data Governance, and Data Observability.

• Ensure adherence to security requirements, Brazil’s LGPD, and corporate policies.

• Define strategies for data monitoring, auditing, and lineage.

• Lead strategic, tactical, and operational initiatives in data engineering.

• Mentor and support mid-level and junior data engineers.

• Engage in architectural decisions, technical reviews, impact analyses, and technical roadmap planning.

• Advocate for best practices in development, version control, documentation, and testing.

• Translate business requirements into scalable technical solutions.

• Collaborate closely with Analytics, BI, Product, and other teams to prioritize initiatives and deliver value.

• Contribute to the advancement of the organization’s data strategy.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related discipline.

• Senior-level professional with a minimum of 5 years of direct Data Engineering experience on Google Cloud Platform (GCP).

• At least 3 years of experience with Databricks.

• Proficient in BigQuery, Dataform, Cloud Storage, Pub/Sub, Dataflow, Cloud Composer (Airflow), IAM, Cloud Monitoring, and Cloud Logging.

• Understanding of ETL/ELT processes.

• Advanced SQL skills.

• Advanced Python proficiency.

• Familiarity with Shell scripting.

• Knowledge of data warehousing concepts.

• Understanding of dimensional modeling.

• Knowledge of Data Lakes and Lakehouse architectures.

• Experience with version control using Git.

• Familiarity with CI/CD practices.

• Experience in data testing and automated validation.

• Nice to have: Experience with Terraform, Docker, Kubernetes, Dataplex, Looker, MLOps processes, and event-driven architectures.

• Behavioral competencies: strategic vision, effective communication, analytical thinking, proactivity, complex problem-solving, results orientation, and cross-functional collaboration.

🏝️ Benefits

• Porto Seguro health insurance, with an option to include a spouse and children.

• Porto Seguro dental insurance for employees and their dependents.

• Profit-Sharing and Results Program (PLR).

• Childcare assistance.

• Alelo food and meal vouchers.

• Home office allowance.

• Partnerships with educational institutions, providing discounts and incentives for courses and degree programs.

• Certification incentives, including cloud certifications (GCP, Azure, AWS, and others).

• Livelo points.

• TotalPass.

• Mindself, with incentives for meditation and mindfulness activities.

• 100% remote work.