Senior Manager, Data & AI Architect

This is a fully remote position, open to applicants in Connecticut.

📋 Description

• Design and execute scalable enterprise data architectures utilizing Databricks and contemporary Lakehouse technologies.

• Establish and apply Medallion Architecture patterns across Bronze, Silver, and Gold data layers.

• Architect and develop semantic layers for coherent enterprise metrics, business definitions, and analytics.

• Create unified analytics-ready data products that integrate ECC and S/4HANA structures.

• Collaborate with SAP functional specialists, data engineers, and business stakeholders on data requirements, lineage, and transformation logic.

• Generate conceptual, logical, and physical data models.

• Design architectures for data lakes, Lakehouses, and data warehouses.

• Set data architecture standards, principles, patterns, and best practices.

• Ensure compliance with enterprise governance, VAULTIS principles, and data quality standards.

• Develop strategies for batch and streaming data ingestion and integration.

• Work alongside data engineers on ETL/ELT pipelines using Databricks, Apache Spark, and SQL.

• Outline data quality, lineage, metadata management, governance, and observability strategies.

• Construct architectures that support analytics, business intelligence, machine learning, and generative AI use cases.

• Formulate data migration and modernization strategies for legacy systems.

• Confirm that architectures fulfill security, privacy, compliance, scalability, availability, and performance standards.

• Partner with enterprise architects, application teams, data engineers, analysts, data scientists, and business stakeholders.

• Produce architecture documentation, data-flow diagrams, reference architectures, and technical standards.

• Enhance data platform performance, reliability, scalability, and cost efficiency.

• Offer technical leadership and mentorship to data engineering and analytics teams.

• Collaborate with AI/ML teams to prepare, model, and structure SAP data for intelligent applications, including feature engineering and model-ready datasets.

⛳️ Requirements

• Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field with 10+ years of relevant work experience; OR an Advanced Degree with 7+ years of relevant work experience.

• 7+ years of experience in data architecture, data engineering, database architecture, or a similar discipline.

• Extensive experience in designing and implementing modern data architectures and Lakehouse solutions.

• Practical experience with Databricks and the Databricks Data Intelligence Platform.

• Strong understanding of Medallion Architecture, including Bronze, Silver, and Gold data layers.

• In-depth knowledge of Apache Spark, PySpark, and SQL.

• Background in designing data warehouses, data lakes, and/or Lakehouse architectures.

• Proficient knowledge of data modeling, including dimensional, relational, and analytical data models.

• Experience in designing ETL/ELT pipelines and data integration solutions.

• Familiarity with at least one major cloud platform, such as AWS, Microsoft Azure, or Google Cloud.

• Understanding of data governance, data quality, metadata, data lineage, security, and privacy.

• Proven ability to design and implement enterprise-scale data and AI/ML architecture solutions.

• Excellent communication and stakeholder-management capabilities.

• U.S. citizenship is required, as only U.S. citizens are authorized to access information under this program/contract.

• Preferred: Experience with Delta Lake and Delta Live Tables/Lakeflow Declarative Pipelines.

• Preferred: Experience with Unity Catalog.

• Preferred: Experience with Databricks, Delta Lake, Matillion, HVR, or other modern data engineering platforms.

• Preferred: Comprehensive knowledge of SAP modules (MM, SD, FI/CO, PP, PM) and associated master data structures.

• Preferred: Experience supporting large-scale SAP modernization or digital core transformation initiatives.

• Preferred: Experience with batch and real-time/streaming data architectures.

• Preferred: Knowledge of data mesh, data fabric, domain-driven data architecture, and event-driven architectures.

• Preferred: Experience with cloud services facilitating data ingestion, storage, processing, and analytics.

• Preferred: Experience designing data platforms for AI/ML and Generative AI workloads.

• Preferred: Familiarity with data catalog, data quality, data observability, and master data management solutions.

• Databricks, cloud, or data architecture certifications are a plus.

🏝️ Benefits

• Medical insurance.

• Dental insurance.

• Vision insurance.

• Life insurance.

• Short-term disability.

• Long-term disability.

• 401(k) match.

• Flexible spending accounts.

• Flexible work schedules.

• Employee assistance program.

• Employee Scholar Program.

• Parental leave.

• Paid time off.

• Holidays.

• Annual short-term and/or long-term incentive compensation programs.

• Employee referral award eligibility.