Senior Manager, Data – AI Architect

This is a fully remote position, open to applicants in Connecticut.

📋 Description

• Develop and execute scalable enterprise data architectures utilizing Databricks and contemporary Lakehouse technologies.

• Establish and apply Medallion Architecture patterns across Bronze, Silver, and Gold layers.

• Design semantic layers to ensure consistent enterprise metrics, business definitions, and analytics.

• Create unified, analytics-ready data models that integrate ECC and S/4HANA structures.

• Collaborate with SAP functional experts, data engineers, business stakeholders, security teams, application teams, and leadership.

• Specify data requirements, lineage, transformation logic, standards, principles, patterns, and best practices.

• Construct conceptual, logical, and physical data models.

• Develop scalable data lake, Lakehouse, and data warehouse architectures.

• Design strategies for batch and streaming data ingestion and integration.

• Work alongside data engineers to build ETL/ELT pipelines using Databricks, Apache Spark, and SQL.

• Define approaches for data quality, lineage, metadata management, governance, and observability.

• Design architectures that support analytics, business intelligence, machine learning, and generative AI applications.

• Formulate data migration and modernization strategies for legacy systems.

• Ensure compliance with security, privacy, scalability, availability, and performance requirements.

• Produce architecture documentation, data-flow diagrams, reference architectures, and technical standards.

• Identify opportunities to enhance platform performance, reliability, scalability, and cost-effectiveness.

• Provide technical guidance and mentorship to data engineering and analytics teams.

• Prepare, model, and organize SAP data for intelligent applications, including feature engineering and datasets ready for modeling.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Information Technology, Data Engineering, or a related field with over 10 years of relevant work experience; OR an Advanced Degree with more than 7 years of related work experience.

• More than 7 years of experience in data architecture, data engineering, database architecture, or a similar field.

• Extensive experience in designing and implementing modern data architectures and Lakehouse solutions.

• Practical experience with Databricks and the Databricks Data Intelligence Platform.

• Strong familiarity with Medallion Architecture, encompassing Bronze, Silver, and Gold data layers.

• Proficient in Apache Spark, PySpark, and SQL.

• Experience in designing data warehouses, data lakes, and/or Lakehouse architectures.

• Solid knowledge of dimensional, relational, and analytical data modeling.

• Proven experience in designing ETL/ELT pipelines and data integration solutions.

• Familiarity with at least one major cloud platform such as AWS, Microsoft Azure, or Google Cloud.

• Understanding of data governance, data quality, metadata, data lineage, security, and privacy.

• Demonstrated capability to design and implement enterprise-scale data and AI/ML architecture solutions.

• Excellent communication and stakeholder management skills.

• U.S. citizenship is required; only U.S. citizens are authorized to access information under this program/contract.

• Preferred: experience with Delta Lake, Delta Live Tables/Lakeflow Declarative Pipelines, Unity Catalog, SAP modules and modernization initiatives, batch and streaming architectures, data mesh, data fabric, domain-driven and event-driven architectures, cloud data services, AI/ML and generative AI platforms, data catalog, data quality, observability, master data management, and relevant certifications.

🏝️ Benefits

• Medical insurance.

• Dental insurance.

• Vision insurance.

• Life insurance.

• Short-term disability.

• Long-term disability.

• 401(k) match.

• Flexible spending accounts.

• Flexible work schedules.

• Employee assistance program.

• Employee Scholar Program.

• Parental leave.

• Paid time off.

• Holidays.

• Annual short-term and/or long-term incentive compensation programs may be available.

• Employee referral award may be available.

• Remote work primarily from home.

• Interview process may include specific in-person steps at an office location.