Data Engineer – BI

This is a fully remote position, open to applicants in New York.

📋 Description

• Create and manage semantic data models, metrics layers, and certified datasets that serve as a reliable, business-oriented source of truth for reporting and self-service analytics.

• Establish, standardize, and oversee KPIs, calculation logic, and a shared metric glossary to ensure that metrics are reliable and consistent across dashboards and self-service analytics.

• Design, maintain, and enhance dashboards and reports primarily in Sigma, along with some use of Power BI and native Databricks dashboards/AI-BI Genie, empowering business users to analyze data through governed self-service analytics.

• Set and uphold Sigma workspace standards (including workbook templates, certified datasets, RLS configuration, and naming/governance conventions) within the development instance for promotion across tenant environments, collaborating with Platform Engineering for tenant-level administration.

• Work alongside the Architecture team on data quality, testing, and observability; take ownership of the triage and resolution of BI-layer/dashboard issues.

• Promote BI adoption by training and supporting business users, tracking dashboard usage, and identifying underutilized or redundant assets for redesign, training, or decommissioning.

• Ensure data security and compliance by implementing role-based access controls for security, encryption, masking, and governance best practices to guarantee compliant handling of sensitive information.

• Collect reporting and analytics needs from business stakeholders, define success metrics, and convert them into technical specifications and well-organized data products.

• Facilitate analytics, reporting, and AI/ML use cases through well-structured, business-friendly data models, feature availability, and platform integrations, utilizing tools such as Databricks Vector Search and Model Serving.

• Collaborate within an Agile-Scrum framework while developing detailed technical design documentation to ensure efficient and successful project delivery.

• Construct and uphold production dashboards and workbooks in Sigma, ensuring reliability and performance for business users.

• Implement row-level security and Entra ID-based access controls to manage and secure data access within the BI/data platform.

• Engage and communicate proactively with engineering, analytics, and business stakeholders, influencing priorities and fostering alignment across teams.

⛳️ Requirements

• A minimum of 3 years of practical experience in data engineering and/or business intelligence is required.

• Proficiency in Databricks, including DAB and Materialized Views.

• At least 3 years of experience designing semantic/dimensional data models and creating dashboards and reports in a modern BI platform, including hands-on experience with a metrics or semantic layer is required.

• Over 3 years of experience with analytical SQL (ANSI SQL/T-SQL/Spark SQL) and Python for data engineering, encompassing pipeline construction, transformation logic, and automation is required.

• Familiarity with Azure DevOps; knowledge of GitHub CoPilot is a plus.

• Bachelor’s degree in Computer Science, Information Technology, or a related field is required; a Master’s degree is preferred.

• Experience with HIPAA compliant data sets is a plus.

🏝️ Benefits

• This position is remote with occasional travel requirements.

• Preference will be given to candidates located on the East Coast.