Data Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Design and develop scalable data architectures to facilitate machine learning models and generative AI.

• Create and enhance pipelines for the ingestion, processing, and storage of large data volumes.

• Collaborate with solution architects and machine learning engineers to convert business needs into effective technical solutions.

• Maintain data quality, governance, and security by implementing best practices in data engineering.

• Deploy MLOps strategies to automate pipelines and manage model versioning.

• Partner on the integration of APIs and distributed systems for real-time data processing.

• Oversee the performance and scalability of data systems, pinpointing opportunities for optimization.

⛳️ Requirements

• Extensive experience in data modeling and ETL, including frameworks like Apache Airflow, Azure Data Factory, or Spark.

• Proficient in SQL databases (PostgreSQL, MySQL) and NoSQL databases (MongoDB, Redis, Cassandra).

• Familiarity with VectorDBs, such as Qdrant, is considered a significant advantage.

• Experience with big data architectures and distributed processing.

• Knowledge of Python (Pandas, PySpark) and MLOps tools (MLflow, Kubeflow, Vertex AI).

• Experience with cloud computing platforms (AWS, Azure, GCP, or OCI).

• Understanding of containers and orchestration (Docker, Kubernetes).

• Background in data security and governance.

🏝️ Benefits

• Meal voucher and/or food allowance of R$807.30 per month on the iFood card.

• SulAmérica health insurance (fully covered by the company).

• MetLife dental plan.

• Pet health plan.

• Life insurance.

• Totalpass and Wellhub access for fitness activities anytime, anywhere.

• Birthday Day Off to celebrate your special day as you choose.

• Partnership with Sesc.

• Collaboration with OnHappy (discounts on hotels and travel).

• Partnerships with educational institutions.

• Childcare reimbursement.

• Provision of work equipment.

• Culture focused on feedback and development.

• Dynamic environment offering significant growth opportunities.

• Payroll-deductible loans with competitive interest rates.

• Variable compensation to acknowledge performance and cultural fit.