Senior Data Engineer – GCP

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design and enhance data pipelines and solutions, encompassing ingestion, processing, modeling, and delivery to the organization.

• Collaborate with business teams to refine and document prioritized initiatives by collecting requirements, needs, and dependencies.

• Create and sustain data pipelines utilizing ETL/ELT methodologies.

• Develop and advance the data platform across Raw, Trusted, and Refined layers, ensuring high quality, reliability, and scalability.

• Structure tables and data architectures based on business rules, forming the semantic layer for analytical and strategic use.

• Establish and enhance storage and processing solutions across Data Lake/Lakehouse frameworks, relational databases, and non-relational databases.

• Develop integrations between processed data and external tools or applications, including Google Apps Script.

• Design, prototype, and validate dashboards and visualization solutions in collaboration with business teams.

• Partner with analysts and stakeholders to transform business requirements into efficient and sustainable data solutions.

• Engage in alignment sessions, meetings, and ceremonies with clients and business teams.

• Investigate new technologies and contribute to projects involving Artificial Intelligence applied to data.

⛳️ Requirements

• Significant experience in Data Engineering.

• Proficient in SQL and Python.

• Experience in Data Engineering within cloud environments, ideally GCP (Google Cloud Platform).

• Practical experience with BigQuery, Cloud Storage, and Cloud Functions.

• Familiarity with Cloud Run, Artifact Registry, Docker, Dockerfiles, and CI/CD practices.

• Proven track record of building and maintaining data pipelines, with an understanding of the medallion architecture (Raw, Trusted, and Refined).

• Knowledge of Data Lake/Lakehouse, data modeling, and best practices for storage, processing, and loading.

• Experience using data workflow orchestration tools such as Airflow, Luigi, Kubeflow, or similar platforms.

• Familiarity with agile methodologies and task management tools, preferably Jira.

• Excellent communication skills and the ability to convert business needs into technical solutions.

• A curious mindset, adaptability, and a keen interest in new technologies, with the willingness to work on initiatives related to Artificial Intelligence.

• Preferred: experience with data visualization tools and dashboard development.

• Preferred: experience in integrating data platforms with external applications.

• Preferred: experience in projects involving Artificial Intelligence applied to data.

🏝️ Benefits

• Meal and food allowance provided on the FLASH card.

• Home office allowance provided on the FLASH card.

• Health insurance based on your location.

• Dental insurance based on your location.

• Birthday day off, along with a monetary deposit onto the FLASH card.

• Extended maternity and paternity leave.

• Profit-sharing plan (PLR).

• Life insurance coverage.

• Childcare assistance available.

• Referral bonus program.

• Transportation allowance provided.

• Clude | Healthcare Platform access.

• TotalPass membership.

• Partnership with FECAP offering 10% to 20% discounts on undergraduate, graduate, MBA, and master’s degree programs.