Senior Data Architect – Databricks

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Craft and execute scalable, contemporary data architectures (Lakehouse, Delta Lake, Medallion)

• Collaborate with business and technology teams to ensure solutions are aligned with strategic objectives

• Spearhead modernization and technology advancement initiatives incorporating AI, agents, and machine learning (ML)

• Uphold governance, security, and compliance standards (LGPD, IAM, RBAC)

• Engage in strategic data planning, ensuring solutions are in line with corporate goals

• Assist in defining data roadmaps and contribute to long-term architectural strategies

• Conduct regular alignment meetings with both technical and business stakeholders

• Create data pipelines utilizing Databricks, Azure Data Factory, and Synapse

• Merge machine learning solutions with Vertex AI and analytical pipelines with BigQuery

⛳️ Requirements

• Extensive experience with Azure: Data Lake Gen2, Databricks (Delta Lake), Synapse, and Unity Catalog

• Expertise in Python and SQL for large-scale ETL/ELT processes

• Familiarity with Data Mesh architecture and data domains

• Understanding of data governance and data security principles

• Proven experience in data modeling and both batch and streaming processing

• Background in developing pipelines using Databricks, Azure Data Factory, and Synapse

• Application of DataOps methodologies and CI/CD practices using GitHub/Azure DevOps

• Experience with GCP, BigQuery, Vertex AI, and Dataflow is an advantage

• Familiarity with multi-cloud environments (Azure, AWS, GCP) is beneficial

• Azure or GCP certifications are advantageous

• Knowledge of MLflow, Spark, and Airflow is a plus

• Strategic mindset with a focus on delivering business value

• Excellent communication skills with technical stakeholders and executives

• Attributes such as proactivity, autonomy, collaboration, adaptability, ownership mindset, and customer focus are essential

🏝️ Benefits

• Meal/food voucher of R$38/day (flexible card)

• Flexible allowance of R$210/month (flexible card)

• TotalPass

• Health and dental insurance

• Life insurance

• Profit-sharing (PLR)

• Birthday day off

• Training and certifications funded by Aggrandize

• Employee referral program with incentives

• Career development opportunities