Mid-Level Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Create and execute efficient batch and streaming data pipelines, integrating various sources and formats.

• Manage and optimize databases and data lakes, ensuring their security and performance.

• Develop processes for data ingestion, transformation, and delivery (ETL/ELT).

• Ensure quality, integrity, and consistency of data throughout its lifecycle.

• Collaborate with teams in data science, analytics, and software development.

• Monitor and automate data workflows, suggesting continuous enhancements to the architecture.

• Implement best practices for version control, documentation, and data governance.

• Contribute to fostering a data-driven culture within innovation teams.

⛳️ Requirements

• Proven experience as a Data Engineer.

• Proficient in data-focused programming languages (Python, SQL, Scala, or similar).

• Familiarity with data processing tools and frameworks (Airflow, Spark, Kafka, dbt, Pub/Sub, Kinesis, Cloud Functions, Lambda Functions, etc.).

• Understanding of relational and non-relational databases (PostgreSQL, MongoDB, BigQuery, Redshift, etc.).

• Knowledge of MLOps (Vertex AI, Amazon SageMaker/Bedrock).

• Experience with cloud environments (GCP and AWS) and managed data services.

• Adherence to best practices in version control (Git) and continuous integration.

• Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related discipline.

• Preferred knowledge of data modeling for AI, Machine Learning, and/or Deep Learning.

• Familiarity with data governance and cataloging tools, such as Data Catalog (preferred).

• Experience with infrastructure as code (Terraform, CloudFormation) (preferred).

• Preferred certifications in cloud data engineering or architecture (Google Professional Data Engineer or AWS Data Engineer).

🏝️ Benefits

• 100% remote work, depending on the contract model.

• Accessibility and inclusion: this position is also open to persons with disabilities.