Data Engineer, AWS, Databricks – Mid-level

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Reverse-engineer code to document pipelines;

• Analyze execution flows and identify dependencies among processes;

• Support the planning of data load migrations;

• Create automated analyses to streamline the reverse-engineering process;

• Design scalable and resilient data analytics solutions on AWS;

• Implement enhancements to architecture;

• Gather requirements from business units and document them;

• Knowledge of agile methodologies;

• Ensure alignment of the corporate IT environment with business requirements, standards, and industry best practices;

• Foster a data-driven culture in everyday operations;

• Demonstrate the ability to collaborate within a team empathetically, actively listen, and communicate effectively;

⛳️ Requirements

• At least 5 years of experience with AWS (S3, EMR, Athena, Lambda, SQS, AWS Glue, RDS, Redshift);

• A minimum of 3 years of experience with Databricks;

• At least 3 years of experience with PySpark;

• Knowledge of Spark architecture and the intricacies and challenges associated with distributed systems;

• Experience with Oracle databases and PL/SQL;

• **Preferred:**

• AWS certification: Professional or Specialty;

• Databricks certification;

🏝️ Benefits

• 100% remote position