Senior Data Engineer – Focus on Governance, Catalog, and Operational FinOps

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Collaborate within the Platform Squad, concentrating on Governance, Security, and FinOps on Google Cloud Platform (GCP).

• Establish and enhance data governance on GCP utilizing Dataplex Catalog, Aspect Types, Entry Groups, Business Glossary, Data Lineage, and Data Profiling.

• Create automation for metadata collection, cataloging, and enrichment using Python, SQL, Dataform/dbt, APIs, and AI/LLMs.

• Design mappings for Looker Studio dashboards and their data sources.

• Analyze jobs, storage, reservations, and unused tables through INFORMATION_SCHEMA and Cloud Billing to monitor and optimize BigQuery costs.

• Enforce FinOps policies, which include cost labeling, usage alerts, project/user quotas, and automation for table purging and archiving.

• Automate security and privacy policies in BigQuery utilizing Cloud IAM, Policy Tags, RLS, Dynamic Data Masking, and Sensitive Data Protection (Cloud DLP), ensuring adherence to Brazil’s LGPD.

• Specify Data Contracts, YAML/JSON schemas, and structure evolution rules, incorporating validations into CI/CD pipelines.

• Develop governance, cost, and Data Lake health metrics and dashboards.

• Offer consultative assistance to both technical and business teams.

⛳️ Requirements

• Extensive experience in Data Engineering and governance on GCP, particularly with BigQuery and Dataplex, including familiarity with the current Dataplex Catalog architecture (Aspect Types and Entry Groups).

• High proficiency in Python and SQL for automation, auditing, and the development of metadata pipelines.

• In-depth understanding of BigQuery INFORMATION_SCHEMA, Cloud Audit Logs, BigQueryAuditMetadata, Cloud Billing, and GCP APIs, including the Looker Studio API.

• Proven experience with FinOps and optimizing BigQuery costs, encompassing On-Demand, Editions/Slots, Logical/Physical Storage, Time Travel, partitioning, and clustering.

• Knowledge of data security and privacy regulations, including Cloud IAM, Policy Tags, CLS, RLS, dynamic masking, and LGPD compliance.

• Experience with Data Contracts, YAML/JSON Schema, Schema Evolution, and integrating validations into CI/CD processes.

• Understanding of performance and caching implications related to BigQuery security policies.

• Background in Sensitive Data Protection (Cloud DLP) and automated sensitive data classification.

• FinOps Certified Practitioner or Google Cloud Professional Cloud Security / Data Engineer certification is preferred.

• Awareness of Data Contract standards such as ODCS and Data Contract Specification.

• Experience with LLMs, AI agents, and tools like Antigravity for metadata enrichment and semantic data classification.

• Familiarity with Dataform/dbt along with automation of data cataloging and documentation.

🏝️ Benefits

• Meal or food allowance.

• Discounts on courses, universities, and language institutions.

• Access to the Stefanini Academy — a platform offering free, up-to-date online courses with certificates.

• Mentoring opportunities.

• Benefits club for medical consultations and tests.

• Health insurance coverage.

• Dental insurance provided.

• Exclusive benefits and discounts at leading establishments.

• Membership in a travel club.

• Pet benefits program.

• Flexible remote work options.