Data Engineering Tech Lead

Posted 1 day ago

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Lead the technical development and maintenance of scalable, robust data ingestion and transformation pipelines utilizing AWS and Databricks.

• Act as a technical resource for the engineering team, providing support for architectural decisions, development standards, and industry best practices.

• Construct and oversee a Lakehouse architecture structured into bronze, silver, and gold layers.

• Integrate transactional environments, files, and various enterprise sources into a contemporary data architecture.

• Ensure optimal performance and scalability through strategic partitioning, Spark tuning, parallel processing, and workload optimization.

• Define and advocate for best practices in data engineering, version control, testing, observability, security, and governance.

• Conduct data modeling to facilitate Analytics and BI, including dimensional modeling when applicable.

• Lead the technical aspects of troubleshooting, root cause analysis, and the ongoing enhancement of deployed solutions.

• Collaborate with multidisciplinary teams, business stakeholders, and technical leadership to ensure quality and alignment with corporate objectives.

• Support the management of technical deliveries, code reviews, team mentoring, and the enhancement of engineering maturity.


⛳️ Requirements

• Demonstrated experience in leading teams.

• A minimum of 6 years of experience in Analytics, BI, and Data Engineering.

• At least 4 years of hands-on experience in production environments with Databricks.

• Extensive experience with data architecture on AWS and Databricks.

• Proven experience with enterprise Lakehouse architecture.

• Familiarity with AWS data services including S3, Glue, IAM, Lambda, CloudWatch, Secrets Manager, Step Functions, and related services.

• Strong proficiency in Spark, PySpark, and Python.

• Experience in integrating data from transactional and diverse sources.

• Solid experience in Business Intelligence and dimensional modeling.

• Experience with Git and CI/CD practices as applied to data pipelines.

• Knowledge of best practices for data security, governance, traceability, and observability.

• Prior experience serving as a technical reference, technical lead, or technical leader of engineering teams.

• Proficiency in English.

• Preferred: Experience with Delta Lake, workload optimization, and performance-focused architecture.

• Preferred: Experience in projects with security, audit, and compliance requirements.

• Preferred: Understanding of data governance and observability solutions.

• Preferred: Experience with Redshift, Athena, EMR, or other complementary services within the AWS ecosystem.

• Preferred: Databricks Data Engineer Associate or Professional certification.

• Preferred: AWS Solutions Architect Associate, AWS Data Engineer Associate, or higher certification.

• Big Data / Streaming: Spark.

• Big Data / Streaming: Apache Airflow.

• Database: SQL Server.

• Database: MySQL.


🏝️ Benefits

• Multi-benefit card – choose how and where to utilize it.

• Scholarships for undergraduate, graduate, MBA, and language courses.

• Certification incentive programs.

• Flexible working hours.

• Competitive salaries.

• Annual performance review accompanied by a structured career development plan.

• International career opportunities.

• Wellhub and TotalPass.

• Private pension plan.

• Childcare assistance.

• Medical insurance.

• Dental insurance.

• Life insurance.

People also viewed

Trax Technologies7 hours ago

Data Architect

US flagUnited States OnlyFull-timeData Engineer
ApplyView job
Fiserv7 hours ago

Senior Snowflake Data Platform and Artificial Intelligence Architect

US flagUnited States OnlyFull-timeData Engineer
ApplyView job
Ontrac Solutions8 hours ago

Staff Data Engineer

US flagUnited States OnlyFreelanceData Engineer
ApplyView job
General Dynamics Information Technology8 hours ago

ICAM Identity Data Management Engineer – Radiant Logic

US flagUnited States OnlyFull-timeData Engineer$170k – $230k/year
ApplyView job
General Dynamics Information Technology8 hours ago

Identity Data Management Engineer – Radiant Logic

US flagUnited States OnlyFull-timeData Engineer$170k – $230k/year
ApplyView job
General Dynamics Information Technology8 hours ago

Senior Data Engineer

US flagUnited States OnlyFull-timeData Engineer$102k – $138k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers