Senior Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design, develop, and maintain scalable and resilient data pipelines for batch and/or streaming processes on GCP.

• Create mechanisms for ingesting, transforming, and providing access to data from various sources.

• Model data to facilitate analytical use, adhering to best practices for performance and cost-effectiveness.

• Orchestrate and oversee data workflows, addressing failures while ensuring data quality and reliability.

• Implement best practices for version control, CI/CD, testing, and technical documentation.

• Work collaboratively with architects, analysts, and business teams, participating in meetings conducted in English.

• Contribute to technical decision-making and assist in the ongoing development of the data architecture.

⛳️ Requirements

• Strong experience as a Data Engineer, operating at a senior level.

• Hands-on experience with GCP data services, including BigQuery, Dataflow, Cloud Composer (Airflow), Pub/Sub, Cloud Storage, and Dataproc.

• Expertise in SQL and Python.

• Experience in data modeling, whether dimensional or for data lake/lakehouse architectures.

• Familiarity with version control systems (Git) and CI/CD methodologies.

• Proficient in English at an advanced level.

🏝️ Benefits

• Flexible remote work arrangement.