Tech Lead – Databricks/AWS

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Technical Leadership: Serve as the main technical authority collaborating with client teams, overseeing platform and architecture initiatives while evaluating the existing ecosystem.

• Architecture Definition: Take ownership of the target architecture and establish technical standards for project assessment and delivery.

• Quality and Governance: Spearhead the refinement of the technical backlog, conduct code reviews, and guarantee top-notch data engineering practices.

• Mentorship: Provide guidance and mentorship to the development squad, advocate for best practices, and facilitate the technical growth of the team.

⛳️ Requirements

• Experience: Proven background in data and technology with a solid record in technical leadership and architecture.

• Languages: Proficiency in English (essential for daily interactions and alignment).

• Data Architecture: Extensive knowledge of Lakehouse architecture and the medallion architecture (Bronze, Silver, Gold), including Delta Lake and Delta Live Tables.

• Databricks & Performance: Proficient in PySpark / Spark SQL performance optimization, Photon, cluster sizing, and cost management.

• Governance: Practical experience with Unity Catalog for data governance, including lineage, access control, data contracts, and catalog design.

• Data Ingestion: Familiarity with streaming and batch ingestion methodologies utilizing Auto Loader and Structured Streaming.

• DevOps / DataOps: Experience in CI/CD using Databricks Asset Bundles, Infrastructure as Code (IaC), and DataOps automation on AWS.

🏝️ Benefits

• Meal or food allowance;

• Discounts on courses, universities, and language schools;

• Stefanini Academy — a platform offering free, up-to-date online courses and certifications;

• Mentoring;

• Discount program for medical consultations and examinations;

• Health insurance;

• Dental insurance;

• Perks and discounts at leading retailers and establishments;

• Travel club;

• Pet care benefits.