Data Engineer, Mid-Level

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design and improve scalable data pipelines.

• Create processes for data ingestion, transformation, and delivery.

• Collaborate with Spark and Databricks utilizing a medallion architecture.

• Manage data workflows and pipelines effectively.

• Ensure data quality, governance, and observability are maintained.

• Enhance processing performance and cost efficiency.

• Participate in engineering best practices, version control, and documentation efforts.

• Assist BI, Analytics, and AI teams on various projects.

⛳️ Requirements

• Bachelor’s degree in Information Technology, Engineering, or a related discipline.

• Demonstrated experience in data engineering and the development of ETL/ELT pipelines.

• Strong proficiency in Python and advanced SQL.

• Familiarity with Spark and Databricks.

• Understanding of Lakehouse/Data Lake architecture.

• Experience with orchestration tools, including Apache Airflow.

• Knowledge of analytical data modeling techniques (Star Schema, Snowflake, OBT, etc.).

• Proficient with data ingestion and integration tools (e.g., Azure Data Factory, Airbyte, etc.).

• Familiarity with Git and software development best practices.

🏝️ Benefits

• Opportunities for professional development.

• A dynamic and engaging work environment.

• Support for initiative, innovation, and learning from mistakes.

• Recognition of contributions and celebration of accomplishments.

• A diverse and inclusive workplace.

• Affirmative-action positions available for individuals with disabilities.