Mid-Level Data Engineer

Posted 2 days ago

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design, develop, and maintain architectures, pipelines, and solutions in data engineering.

• Create and manage solutions utilizing Databricks, Apache Spark/PySpark, SQL, and Delta Lake.

• Build and enhance workflows for ingesting, transforming, and processing large datasets.

• Define and execute data models and architectures suitable for analytical settings.

• Implement optimal practices for data governance, security, quality assurance, and access management.

• Integrate various data sources, systems, and cloud services effectively.

• Employ CI/CD, version control, and automation techniques to guarantee quality delivery.

• Monitor and fine-tune data solutions to ensure high performance, scalability, and reliability.

• Produce and uphold technical documentation for architectures, standards, data flows, and decision-making regarding solutions.


⛳️ Requirements

• Bachelor's degree in Information Technology or a related discipline.

• Familiarity with Databricks, encompassing notebooks, jobs/workflows, clusters, and Lakehouse architecture.

• Proven experience in data architecture and engineering, specifically in developing and supporting data solutions.

• Proficient with Apache Spark/PySpark and SQL for the processing and transformation of substantial data volumes.

• Understanding of Delta Lake, focusing on data organization, processing, and optimization.

• Experience in data modeling and establishing architectures for analytical frameworks.

• Knowledge of data governance, security, quality assurance, and access control, ideally with Unity Catalog.

• Experience in integrating and ingesting data from diverse sources and systems.

• Familiarity with CI/CD, Git, and version control principles applied to data solutions.

• Understanding of cloud environments, preferably Microsoft Azure, and integration with services within the Databricks ecosystem.


🏝️ Benefits

• Meal or food allowance.

• Discounts on courses, universities, and language institutions.

• Stefanini Academy — a platform providing free, current online courses with certification.

• Mentoring opportunities.

• Benefits club offering discounts on consultations and medical tests.

• Health insurance coverage.

• Dental insurance coverage.

• Benefits and discounts at prominent establishments.

• Travel club membership.

• Pet benefits program.

People also viewed

Trax Technologies11 hours ago

Data Architect

US flagUnited States OnlyFull-timeData Engineer
ApplyView job
Fiserv11 hours ago

Senior Snowflake Data Platform and Artificial Intelligence Architect

US flagUnited States OnlyFull-timeData Engineer
ApplyView job
Ontrac Solutions11 hours ago

Staff Data Engineer

US flagUnited States OnlyFreelanceData Engineer
ApplyView job
General Dynamics Information Technology11 hours ago

ICAM Identity Data Management Engineer – Radiant Logic

US flagUnited States OnlyFull-timeData Engineer$170k – $230k/year
ApplyView job
General Dynamics Information Technology11 hours ago

Identity Data Management Engineer – Radiant Logic

US flagUnited States OnlyFull-timeData Engineer$170k – $230k/year
ApplyView job
General Dynamics Information Technology11 hours ago

Senior Data Engineer

US flagUnited States OnlyFull-timeData Engineer$102k – $138k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers