Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Develop ETL/ELT solutions and facilitate data integration across various systems and data sources.

• Create, implement, and oversee data pipelines for the ingestion, storage, and processing of substantial data volumes.

• Work collaboratively with other teams to guarantee data security and adherence to compliance regulations.

• Design, build, and execute strategies to enhance the performance and scalability of data processing systems.

⛳️ Requirements

• Bachelor's degree in Computer Science, Computer Engineering, Information Systems, Systems Analysis and Development, or a related field;

• Proficient in intermediate English;

• Utilize knowledge of data pipeline concepts and tools to carry out data transformation, cleaning, and aggregation tasks.

• Employ data pipeline frameworks and libraries to automate data processing operations and enhance workflows.

• Adhere to best practices for developing data pipelines, including version control, testing, and comprehensive documentation.

• Demonstrate programming expertise in Python, PySpark, Scala, and SQL to effectively manipulate and transform data.

• Comprehend and leverage cloud computing platforms and services from providers like AWS, Azure, and Google Cloud.

• Construct data pipelines using orchestration frameworks (e.g., Apache Airflow, Luigi, Mage, Databricks Workflows), integrating with PySpark and/or Scala as necessary.

• Grasp and apply software design principles in data engineering initiatives.

• Implement data modeling techniques to create efficient and scalable data models.

• Enhance PySpark and SQL query performance, taking into account data volume, query complexity, and system resources.

• Utilize data tools for ingestion, transformation, analysis, and visualization.

🏝️ Benefits

• Performance-based bonus*

• Attendance bonus*

• Private pension plan

• Meal allowance

• Casual office and dress code

• Days off*

• Health, dental, and life insurance

• Medicines discounts

• WellHub partnership

• Childcare subsidies

• Discounts on Ambev products*

• Clube Ben partnership

• Scholarship*

• Assurance for school materials

• Language and training platforms

• Transport allowance