Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Establish monitoring systems and protocols for data, applications, queries, and other components.

• Enhance data models and architecture, while constructing data pipelines to accommodate new engineering and business needs.

• Execute data migration, processing, and storage procedures (ETL).

• Create integrations among various data sources (RDS, external APIs, and others) to consolidate data in a data lake.

• Conduct and implement load testing.

• Oversee data pipelines in a production environment.

⛳️ Requirements

• Proficiency in Python.

• Familiarity with Google Cloud Platform (GCP).

• Experience with continuous integration and cloud deployment.

• Knowledge of data lakes, data warehouses, and data marts.

• Understanding of SQL and NoSQL databases.

• Awareness of cloud platform services and resources.

• Insight into event-driven architecture.

• Experience with streaming projects is advantageous.

• Familiarity with Airflow is beneficial.

• Background in distributed data processing (Spark or similar technologies) is a plus.

🏝️ Benefits

• Competitive salary package.

• Opportunities for professional development and growth.

• Flexible working hours and remote work options.

• Health and wellness benefits.

• Collaborative and innovative work environment.