
Data Engineering Tech Lead
Posted 1 day ago

Posted 1 day ago
This is a fully remote position, open to applicants in Brazil.
• Lead the technical development and maintenance of scalable, robust data ingestion and transformation pipelines utilizing AWS and Databricks.
• Act as a technical resource for the engineering team, providing support for architectural decisions, development standards, and industry best practices.
• Construct and oversee a Lakehouse architecture structured into bronze, silver, and gold layers.
• Integrate transactional environments, files, and various enterprise sources into a contemporary data architecture.
• Ensure optimal performance and scalability through strategic partitioning, Spark tuning, parallel processing, and workload optimization.
• Define and advocate for best practices in data engineering, version control, testing, observability, security, and governance.
• Conduct data modeling to facilitate Analytics and BI, including dimensional modeling when applicable.
• Lead the technical aspects of troubleshooting, root cause analysis, and the ongoing enhancement of deployed solutions.
• Collaborate with multidisciplinary teams, business stakeholders, and technical leadership to ensure quality and alignment with corporate objectives.
• Support the management of technical deliveries, code reviews, team mentoring, and the enhancement of engineering maturity.
• Demonstrated experience in leading teams.
• A minimum of 6 years of experience in Analytics, BI, and Data Engineering.
• At least 4 years of hands-on experience in production environments with Databricks.
• Extensive experience with data architecture on AWS and Databricks.
• Proven experience with enterprise Lakehouse architecture.
• Familiarity with AWS data services including S3, Glue, IAM, Lambda, CloudWatch, Secrets Manager, Step Functions, and related services.
• Strong proficiency in Spark, PySpark, and Python.
• Experience in integrating data from transactional and diverse sources.
• Solid experience in Business Intelligence and dimensional modeling.
• Experience with Git and CI/CD practices as applied to data pipelines.
• Knowledge of best practices for data security, governance, traceability, and observability.
• Prior experience serving as a technical reference, technical lead, or technical leader of engineering teams.
• Proficiency in English.
• Preferred: Experience with Delta Lake, workload optimization, and performance-focused architecture.
• Preferred: Experience in projects with security, audit, and compliance requirements.
• Preferred: Understanding of data governance and observability solutions.
• Preferred: Experience with Redshift, Athena, EMR, or other complementary services within the AWS ecosystem.
• Preferred: Databricks Data Engineer Associate or Professional certification.
• Preferred: AWS Solutions Architect Associate, AWS Data Engineer Associate, or higher certification.
• Big Data / Streaming: Spark.
• Big Data / Streaming: Apache Airflow.
• Database: SQL Server.
• Database: MySQL.
• Multi-benefit card – choose how and where to utilize it.
• Scholarships for undergraduate, graduate, MBA, and language courses.
• Certification incentive programs.
• Flexible working hours.
• Competitive salaries.
• Annual performance review accompanied by a structured career development plan.
• International career opportunities.
• Wellhub and TotalPass.
• Private pension plan.
• Childcare assistance.
• Medical insurance.
• Dental insurance.
• Life insurance.
Trax Technologies
Fiserv
Ontrac Solutions
General Dynamics Information Technology
Get handpicked remote jobs straight to your inbox weekly.