Senior Data Engineer, AWS

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Develop data ingestion and transformation workflows utilizing PySpark within an AWS cloud environment.

• Implement software development best practices for distributed processing.

• Construct and enhance the data lake while collaborating in multidisciplinary teams.

• Engage with stakeholders to discuss business requirements, contributing to the creation of new products and data-driven insights that reveal opportunities and enhance business and product performance.

• Comprehend and apply best practices for executing data projects.

⛳️ Requirements

• A Bachelor’s degree in Computer Science, Computer Engineering, Systems Analysis, or a related discipline.

• Proficiency in cloud services and software architecture, ideally AWS; Azure or GCP will also be considered.

• In-depth understanding of Big Data ecosystems, including Hadoop, HDFS, MapReduce, Kafka, and others.

• Strong expertise in distributed processing technologies, including Spark, RDDs, PySpark, and Spark SQL.

• Familiarity with ETL tools such as PowerCenter, DataStage, Pentaho, or similar platforms.

• Knowledge of process automation tools like Airflow and Control-M.

• Advanced proficiency in Python programming for data applications.

• Familiarity and practical experience with Agile methodologies.

• Experience in technical leadership, coupled with strong time-management and communication skills, including the ability to convey data-related concepts to non-specialists.

• Ability to adapt to change and maintain a mindset geared towards process innovation.

• Experience in designing strategic data architectures.

• Strong expertise in data visualization and front-end tools such as Power BI, QuickSight, or similar platforms.

• A collaborative mindset, problem-solving attitude, and strong interpersonal skills.

• Advanced English proficiency is a plus.

• Preferred: knowledge of Business Intelligence.

• Preferred: cloud certification.

🏝️ Benefits

• Porto Seguro medical insurance, with the option to include a spouse and children.

• Porto Seguro dental insurance for employees and their dependents.

• Profit-Sharing and Results Program (PLR).

• Childcare assistance.

• Alelo meal and food allowances.

• Proportional home-office allowance.

• Partnerships with educational institutions, providing discounts and incentives for courses and degree programs.

• Certification incentives, including cloud certifications in GCP, Azure, AWS, and others.

• Livelo points.

• TotalPass.

• MindSelf, with incentives for meditation and mindfulness.

• Continuous professional development opportunities.