
Mid-Level Data Engineer
Posted 2 days ago

Posted 2 days ago
This is a fully remote position, open to applicants in Brazil.
• Design, develop, and maintain architectures, pipelines, and solutions in data engineering.
• Create and manage solutions utilizing Databricks, Apache Spark/PySpark, SQL, and Delta Lake.
• Build and enhance workflows for ingesting, transforming, and processing large datasets.
• Define and execute data models and architectures suitable for analytical settings.
• Implement optimal practices for data governance, security, quality assurance, and access management.
• Integrate various data sources, systems, and cloud services effectively.
• Employ CI/CD, version control, and automation techniques to guarantee quality delivery.
• Monitor and fine-tune data solutions to ensure high performance, scalability, and reliability.
• Produce and uphold technical documentation for architectures, standards, data flows, and decision-making regarding solutions.
• Bachelor's degree in Information Technology or a related discipline.
• Familiarity with Databricks, encompassing notebooks, jobs/workflows, clusters, and Lakehouse architecture.
• Proven experience in data architecture and engineering, specifically in developing and supporting data solutions.
• Proficient with Apache Spark/PySpark and SQL for the processing and transformation of substantial data volumes.
• Understanding of Delta Lake, focusing on data organization, processing, and optimization.
• Experience in data modeling and establishing architectures for analytical frameworks.
• Knowledge of data governance, security, quality assurance, and access control, ideally with Unity Catalog.
• Experience in integrating and ingesting data from diverse sources and systems.
• Familiarity with CI/CD, Git, and version control principles applied to data solutions.
• Understanding of cloud environments, preferably Microsoft Azure, and integration with services within the Databricks ecosystem.
• Meal or food allowance.
• Discounts on courses, universities, and language institutions.
• Stefanini Academy — a platform providing free, current online courses with certification.
• Mentoring opportunities.
• Benefits club offering discounts on consultations and medical tests.
• Health insurance coverage.
• Dental insurance coverage.
• Benefits and discounts at prominent establishments.
• Travel club membership.
• Pet benefits program.
Trax Technologies
Fiserv
Ontrac Solutions
General Dynamics Information Technology
Get handpicked remote jobs straight to your inbox weekly.