Data Engineer – Databricks

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Contribute to the creation and advancement of the new corporate data platform;

• Design and improve scalable, distributed data pipelines;

• Create solutions utilizing Databricks and Apache Spark;

• Engage in the integration, transformation, and provisioning of data across various business sectors;

• Assist with DataOps initiatives, automation, and platform monitoring;

• Collaborate with cross-functional teams in an agile setting;

• Uphold engineering best practices, ensuring quality, version control, and CI/CD;

• Play a role in the architecture and ongoing enhancement of the cloud platform.

⛳️ Requirements

• Completed Bachelor’s degree;

• Demonstrated experience with Databricks and Apache Spark;

• Strong proficiency in Python, SQL, and Scala;

• Experience with cloud computing, ideally on GCP;

• Familiarity with Delta Lake, Parquet, and distributed data formats;

• Understanding of ETL/ELT tools and data integration methods;

• Experience in CI/CD and code versioning using Git;

• Background in agile, collaborative work environments;

• Knowledge of DBT (Data Build Tool).

• ⭐ Nice-to-haves:

• Familiarity with Kubernetes;

• Experience using Terraform;

• Background in data platform modernization projects;

• Experience in the financial sector or high-volume data environments;

• Focused profile in Platform Engineering / Data Platform Engineering.

🏝️ Benefits

• Meal allowance or meal voucher;

• Discounts on courses, universities, and language institutions;

• Stefanini Academy — a platform offering online, free, up-to-date courses with certificates;

• Mentoring opportunities;

• Benefits club for medical consultations and examinations;

• Medical insurance;

• Dental insurance;

• Discount club featuring offers at premier establishments;

• Travel club;

• Pet care benefits.