Senior Data Engineer, GCP, BigQuery, Dataflow

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design, develop, and maintain scalable and resilient data pipelines within the GCP environment (BigQuery, Dataflow, Cloud Functions, Cloud Pub/Sub)

• Recommend and implement enhancements to data architecture

• Create data models to facilitate complex analytics and automated reporting

• Execute efficient ETL/ELT processes, optimizing pipeline performance to guarantee data integrity and accuracy

• Collect requirements from business sectors and teams, documenting and converting them into feasible technical solutions

• Ensure adherence to data governance, quality, and compliance standards

• Offer technical support for data integration challenges, ensuring ongoing system availability

• Align the IT environment with organizational needs, industry standards, and best practices in the market

• Engage in Agile practices, including sprints and ceremonies, to ensure timely and high-quality delivery

• Promote a data-driven culture

• Collaborate empathetically within a team, listening attentively and communicating effectively

• Convert business requirements into scalable and efficient technical solutions

⛳️ Requirements

• Senior-level professional with a minimum of 5 years of hands-on experience in GCP Data Engineering

• At least 3 years of experience with Databricks

• Extensive expertise in the GCP ecosystem (BigQuery, Dataflow, Cloud Functions, Cloud Pub/Sub)

• Proficient in Python, PySpark, and Pandas

• Experience with data integration and data exploration initiatives

• Background in developing Big Data projects

• Understanding of Spark architecture and challenges associated with distributed processing

• Knowledge of Data Warehousing (data loading, key distribution, and performance tuning)

• Data modeling experience for BI/Data Marts (Star Schema/Snowflake) and NoSQL modeling

• Advanced SQL capabilities, with experience in both relational and NoSQL databases

• Ability to thrive in an Agile environment, collaborating with multiple cross-functional teams

• Experience with AWS (e.g., AWS Glue) and comparable ETL/ELT tools

• Familiarity with GCP Data Studio / Looker or similar platforms

• Experience with data visualization tools such as Tableau and Power BI

• Background with Oracle databases

• Proficient in shell scripting, Unix, and Linux

• Relevant Google Cloud certifications

• Experience in implementing data governance and compliance practices

• Experience working within Finance sectors (Finance, Pricing, and/or Controllership)

🏝️ Benefits

• Porto Seguro health insurance, with the option to include a spouse and children

• Porto Seguro dental coverage for employees and dependents

• Profit Sharing and Results Program (PLR)

• Childcare assistance

• Alelo meal and food vouchers

• Home office allowance

• Partnerships with educational institutions, providing discounts and incentives for courses and degree programs

• Certification incentives, including for Cloud certifications (GCP, Azure, AWS, among others)

• Livelo points

• TotalPass

• Mindself, offering incentives for meditation and mindfulness