Data Engineer, Databricks

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Development of a Commercial Credit and Agribusiness platform;

• Create functional and data modeling while considering business requirements;

• Build and maintain scalable and reliable data pipelines using modern processing technologies;

• Ingest, transform, and make data available with high quality and performance;

⛳️ Requirements

• Experience with Apache Spark for distributed data processing;

• Experience with Apache Airflow for orchestrating data pipelines;

• Knowledge of Apache Kafka for real-time data processing and integration;

• Experience with dbt (Data Build Tool) for data transformation and modeling;

• Familiarity with SQL and NoSQL databases, such as PostgreSQL, MongoDB, and Cassandra;

• Experience with cloud data platforms like Databricks, AWS Glue, and BigQuery;

• Understanding of the implementation and maintenance of Data Lake and Data Lakehouse architectures;

🏝️ Benefits

• Opportunity to work on innovative projects;

• Collaborative and dynamic work environment;

• Professional development and growth opportunities;