Senior Data Architect – Technology

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Define and document comprehensive data architectures, encompassing source ingestion through to analytical consumption layers, while ensuring scalability, performance, and governance.

• Establish technical benchmarks, development protocols, and architectural guidelines to foster consistency across various projects and teams.

• Spearhead the adoption and advancement of Lakehouse architecture (Medallion Architecture) within Databricks and Azure environments, focusing on partitioning, clustering, and Delta Table optimization techniques.

• Define and oversee data ingestion strategies for batch processing, incremental updates, CDC, and streaming scenarios.

• Offer technical leadership concerning data modeling decisions that are appropriate for the analytical context and consumption patterns.

• Ensure the implementation of data governance practices, including cataloging, lineage, and access control at the object, row, and column levels.

• Serve in a consultative role with clients, conducting technical discovery, gathering requirements, and presenting architectural proposals.

• Support and review the contributions of data engineers, ensuring compliance with established standards and advocating for development best practices.

• Collaborate with BI, Engineering, and AI teams to establish the data layers that facilitate analytical, semantic, and ML models.

• Assess and recommend technologies, tools, and integration patterns that align with the Azure + Databricks ecosystem.

• Monitor the integrity of data platforms (quality, SLAs, compute and storage costs) and suggest ongoing improvements.

• Participate in pre-sales activities and the technical qualification of opportunities by creating reference architectures and estimating efforts.

⛳️ Requirements

• Extensive experience in cloud data solution architecture specifically on Azure (Data Factory, ADLS Gen2, Azure Synapse, Event Hub, Azure Functions).

• Familiarity with Lakehouse architecture, medallion layers, Delta Lake, and various data ingestion patterns.

• Proficient in Databricks (PySpark/SparkSQL, Spark Declarative Pipelines, Unity Catalog, Databricks Automation Bundles, Lakeflow Connect).

• Strong capability in data modeling tailored for analytical contexts.

• Experience in ingesting data in multiple formats (CDC, APIs, relational and non-relational databases, etc.) and at various frequencies (batch, incremental, streaming, etc.).

• Ability to define and document technical standards, development guidelines, and architectural decisions.

• Experience with pipeline orchestration and data quality controls.

• Understanding of data governance practices (cataloging, lineage, access control, and security at various data/object levels).

• Consultative skills to collaborate with clients, effectively translating business requirements into technical architectures.

🏝️ Benefits

• iFood voucher (meal allowance).

• Cost allowance.

• Health insurance.

• Dental plan.

• Birthday day off.

• Life insurance.

• Extended maternity and paternity leave.

• Educational partnerships.

• TotalPass partnership - health and wellness.

• Clude Saúde partnership.

• Reimbursement programs.

• Flexible working hours.

• Dress code: be yourself.