Engenheiro de Dados Pleno – AWS

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Develop and maintain scalable ETL/ELT data pipelines within the AWS ecosystem.

• Support production pipelines by identifying and addressing failures to ensure high data availability.

• Orchestrate data loads and flows, ensuring reliable, recurring, and monitored execution.

• Implement ingestion, processing, and transformation routines using AWS Glue and Lambda.

• Structure and evolve storage and consumption layers in S3, Redshift, and Athena.

• Design data solutions with a focus on security and cloud cost optimization.

• Apply DataOps practices throughout the pipeline lifecycle, including automation, versioning, and monitoring.

• Enforce data governance guidelines, such as quality, cataloging, and access control.

• Provide reliable and documented data for business areas and analytics teams.

⛳️ Requirements

• Solid experience as a Data Engineer, with involvement in the development and maintenance of pipelines in a production environment.

• Background in building scalable ETL/ELT processes.

• Proficiency in SQL for analytical queries, data transformation, and performance optimization.

• Experience with Python applied to data engineering, focusing on ingestion, transformation, and automation routines.

• Hands-on experience with the AWS data ecosystem (S3, Glue, Redshift, Athena, and Lambda).

• Knowledge in orchestrating pipelines, managing scheduling, dependencies, and reprocessing.

• Technical autonomy to design end-to-end solutions, considering security and cost optimization.

• Understanding of best DataOps practices applied to data, such as automation, versioning, and monitoring.

• Familiarity with data governance, including quality, cataloging, and access control.

• AWS certifications focused on data or solution architecture.

• Experience with orchestration tools like Apache Airflow or AWS Step Functions.

• Experience with infrastructure as code (Terraform or CloudFormation) for provisioning data resources.

• Knowledge of FinOps applied to cloud data environments.

• Prior experience in consulting or serving multiple clients.

🏝️ Benefits

• Continuous training opportunities.

• Dynamic and collaborative company culture.

• Inclusion of persons with disabilities (position also open to PCD candidates).