Data Engineer (Mid-level)

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design and enhance scalable data pipelines.

• Create processes for data ingestion, transformation, and provisioning.

• Utilize Spark and Databricks within a medallion architecture (Bronze/Silver/Gold).

• Coordinate data workflows and pipelines.

• Maintain data quality, governance, and observability.

• Improve processing performance while managing costs.

• Share best practices in engineering, version control, and documentation.

• Assist BI, Analytics, and AI teams/projects by providing reliable and well-structured data.

⛳️ Requirements

• Bachelor's degree in Information Technology, Engineering, or related disciplines.

• Proven experience in data engineering and developing ETL/ELT pipelines.

• Strong proficiency in Python and advanced SQL.

• Familiarity with Spark and Databricks.

• Understanding of Lakehouse/Data Lake architectures.

• Experience with orchestration tools like Apache Airflow.

• Knowledge of analytical data modeling techniques (Star Schema, Snowflake, OBT, etc.).

• Experience using dbt for data transformation and modeling.

• Background in data ingestion and integration tools (e.g., Azure Data Factory, Airbyte).

• Familiarity with Git and software development best practices.

🏝️ Benefits

• Opportunities for professional development.

• A dynamic work environment.

• Acknowledgment of efforts and celebration of achievements.

• Equal employment opportunities for everyone.