Lead Data Engineer, Azure

This is a fully remote position, open to applicants in Costa Rica.

📋 Description

• Comprehend client needs and spearhead the development of robust data platforms utilizing Data Lakehouse architectures, acting as the primary expert in the Azure data ecosystem (Microsoft Fabric, Azure SQL, and Power BI).

• Design and execute scalable data models, ETL/ELT pipelines, and analytics layers within modern cloud ecosystems.

• Create Microsoft Fabric reporting solutions, implementing medallion layering, managing capacity planning, ensuring freshness governance, and configuring CDC/mirroring from Azure SQL into Fabric.

• Enforce strict separation of data layers to ensure PII is excluded by design, maintain multi-tenant isolation within the analytics layer, and comply with 10+ year regulated data retention policies.

• Lead intricate migration initiatives from legacy systems (e.g., AirTable, Smartsheet) to Microsoft Fabric, adeptly managing mid-program form and rule drift, and establishing reliable, per-client export channels.

• Oversee comprehensive analytics projects — from gathering requirements to deployment.

• Mentor junior team members, conduct code reviews, and ensure compliance with quality standards.

• Collaborate closely with cross-functional teams (engineering, product, business) to align data strategies with business objectives.

• Develop and refine complex SQL queries, Power BI semantic models, dashboards, and reports (transitioning from legacy LookML/BigQuery paradigms).

• Troubleshoot performance issues, data inconsistencies, and integration challenges.

• Stay informed about developments in the analytics and cloud data ecosystem.

• Foster innovation in reporting and analytics capabilities, recommending and implementing new tools, frameworks, and practices to enhance the data platform.

• Establish best practices, coding standards, and governance for analytics projects.

• Monitor the performance of data systems and implement optimization strategies.

• Ensure data accuracy, integrity, privacy, security, and compliance through quality control measures.

• Build and manage AI-ready data pipelines, aimed at providing cleaned, segmented data to assistive AI (embeddings, vector stores, and feature stores) and integrating GenAI into analytics and data products.

• Promote the adoption of AI-assisted data engineering within the team: utilizing copilots for SQL/transformation/pipeline code, as well as automated testing and documentation.

• Define governance and quality standards for data utilized by LLMs and agents.

⛳️ Requirements

• Proven expertise with at least 7 - 10 years of relevant experience in the data engineering and business intelligence sectors.

• Strong primary expertise in the **Azure Data Stack, particularly Azure SQL, Microsoft Fabric**, and Power BI (semantic layer design, robust dashboard development), with a minimum of two years of hands-on experience in these specific tools.

• Advanced SQL proficiency and a strong understanding of modern data architecture, including **Data Lakehouse** concepts, medallion architecture, star/snowflake schemas, and dimensional modeling.

• **Proficiency in Python** for data engineering, ETL/ELT processes, and automation tasks.

• Experience in designing and maintaining enterprise-grade **data pipelines** — specifically in Azure environments.

• Demonstrated history of **leading analytics projects** and delivering scalable data solutions.

• Ability to serve as a **player-coach** — guiding while also contributing hands-on.

• Solid understanding of **data governance, security** (especially regarding PII and multi-tenant architectures), and **performance optimization** practices.

• Strong communication skills and the ability to convey complex technical concepts to business stakeholders.

🏝️ Benefits

• Medical Insurance benefits as per company policy.

• Life Insurance as per company policy.

• 12 days of paid vacation, sick leave, and paid holidays in accordance with local law.

• Paternity and maternity leave as per local law.

• Marriage, bereavement, and graduation leaves as per company policy.

• Sick leave and paid holidays as per local law.

• Christmas bonus as per local law.

• Saving Fund “Asociacion Solidarista.”

• Beach house (Managed by the Asociacion Solidarista).

• Discounts in local shops.

• Direct deposit of payroll.

• Paid professional certifications.