Mid-level Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design, develop, and execute efficient and scalable data engineering solutions;

• Collaborate with cross-functional teams to gather requirements and guarantee the delivery of high-quality solutions;

• Implement CI/CD processes for automation and continuous delivery;

• Manage Kubernetes environments, utilizing AWS tools such as EKS;

• Effectively leverage AWS Developer Tools, including CodeCommit, CodeBuild, CodeDeploy, and CodePipeline;

• Develop and optimize Spark (PySpark) jobs for the efficient processing of large data volumes;

• Work with Delta Table to ensure data consistency and reliability;

• Create web crawlers for web data collection and processing;

• Configure and maintain data workflows using Apache Airflow;

• Implement and manage Kafka environments for data streaming;

• Use Terraform to provision and oversee infrastructure as code (IaC);

• Collaborate with Databricks and Snowflake for efficient data storage and processing.

⛳️ Requirements

• Bachelor's degree in Technology or a related field;

• Strong experience with AWS, including EKS, Glue, Athena, IAM, Lambda, ECR, RDS, and DynamoDB;

• Advanced knowledge of CI/CD methodologies;

• Proficiency in Kubernetes;

• Experience in developing with Spark (PySpark) and Delta Table;

• Familiarity with web crawling practices;

• Strong programming skills in Python;

• Experience with Apache Airflow;

• Knowledge of Kafka;

• Experience using Terraform (IaC);

• Familiarity with Databricks and Snowflake;

• Preferred: Certifications and/or courses in Data Engineering;

• Experience with Azure DevOps.

🏝️ Benefits

• Attendance Allowance: Enjoy three additional days off each year to use at your discretion;

• Education Assistance: Receive 50% coverage for development-focused courses, available after one year with the company;

• Home Office Allowance: A monthly stipend to assist with remote work expenses;

• Childcare Assistance: Support for employees with children under 6 years old;

• Year-end Bonus: A special bonus at the end of the year to celebrate with your family;

• Health Insurance: National coverage with co-payments;

• Dental Plan: Comprehensive dental coverage;

• Private Pension Plan: Company contributions to enhance your financial security;

• Life Insurance: Coverage for peace of mind today and tomorrow;

• TRIB PASS – Leisure and Travel Platform: Bancorbrás subsidizes 50% of the monthly fee for access to travel experiences and benefits;

• Meal/Food Allowance (Caju Card): Provided per working day and widely accepted for groceries or daily meals;

• Wellhub (Gympass): Access to thousands of gyms and wellness activities via a comprehensive fitness platform.