Senior Data Engineer – Focus on Platform, Automation, and AI Acceleration

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design and advance a data engineering platform utilizing Google Cloud Platform (GCP)

• Create tools, frameworks, and intelligent pipelines to expedite the development, validation, and deployment of data pipelines and models

• Develop and refine AI-assisted development workflows (Antigravity), which include context libraries, templates, tools, and validations

• Construct and sustain CI/CD pipelines featuring automated SQL validation, contract testing, schema validation, data quality assessments, and performance testing

• Execute cost analysis and query optimization strategies in BigQuery using Dry Run, Query Explain, and identification of inefficient consumption patterns

• Develop Infrastructure as Code (IaC) solutions through Terraform, constructing reusable modules for resource provisioning, permissions, and governance policies within GCP

• Improve orchestration processes using Cloud Composer/Airflow, Cloud Workflows, Eventarc, and Pub/Sub, leveraging metadata-driven and event-driven architectures

• Integrate data engineering, automation, and AI tools into the development workflow, including automated Pull Request validations

• Propel continuous enhancements to the developer experience by minimizing manual tasks, rework, and delivery timelines

⛳️ Requirements

• Extensive experience in Data Engineering on GCP, notably with BigQuery, Cloud Composer/Airflow, Dataflow, Cloud Run, Cloud Functions, and Cloud Workflows

• Advanced skills in Python and SQL, with a background in automation, internal tool development, and integration with GCP APIs and SDKs

• Familiarity with CI/CD (GitHub Actions, GitLab CI, or Cloud Build), Terraform, and DataOps methodologies

• Knowledge of SQL analysis and validation tools like SQLFluff and SQLGlot

• Experience in developing and maintaining automated pipelines, tests, schema validation, and data governance

• Practical experience with AI-assisted development tools, particularly Antigravity, in relation to code generation and validation

• Nice to have: experience with Dataform or dbt, including unit tests, ephemeral environments, and Slim CI

• Nice to have: understanding of SQL AST analysis, data lineage, and automated anti-pattern detection

• Nice to have: experience in developing AI agents, MCP servers, IDE extensions, or automated code review bots (PR Review Bots)

• Nice to have: familiarity with BigQuery cost and performance optimization, including BigQuery Editions and slot consumption

• Nice to have: experience with Golden Paths, Golden Modules, and Platform Engineering practices

🏝️ Benefits

• Meal or food allowance

• Discounts on courses, universities, and language schools

• Stefanini Academy — a platform providing free, up-to-date online courses with certification

• Mentoring

• Benefits club offering discounts on consultations and medical tests

• Health insurance

• Dental insurance

• Benefits and discounts at leading establishments

• Travel club

• Pet care benefits

• Remote work model

• Employment under the Stefanini CLT regime