Solutions Architect – Modern Data Management Platforms

This is a fully remote position, open to applicants in California.

📋 Description

• Take charge of the technical validation, architecture, and development of contemporary data management platforms within Hitachi environments.

• Create and validate comprehensive data management architectures that integrate object storage, open table formats, query engines, governance services, compliance controls, and data pipeline technologies.

• Develop reference architectures for data lakehouse platforms utilizing Apache Iceberg, Parquet, Spark, Kafka, Flink, Airflow, and S3-compatible storage solutions.

• Construct and document technical patterns for data preparation, ETL, ELT, batch processing, and streaming pipelines.

• Define architectural standards for metadata catalogs, data lineage, data quality, data classification, PII discovery, policy enforcement, audit capabilities, retention, and compliance operating models.

• Ensure that solution architectures meet privacy, security, regulatory requirements, data residency, retention, classification, and access governance standards.

• Validate the interoperability of Hitachi platforms with components of the modern data ecosystem.

• Produce customer-facing solution briefs, design guides, technical white papers, demos, and best-practice documentation.

• Collaborate with product management, engineering, field teams, strategic customers, and partners to convert requirements into repeatable solution architectures.

• Assist with proof-of-concept initiatives, technical workshops, and discussions at the executive level regarding solutions.

• Assess emerging technologies related to open table formats, lakehouse architectures, federated queries, AI data management, governance, and compliance-aware data management.

• Act as a subject matter expert in modern data management, positioning Hitachi platforms for governed, compliant analytics and AI workloads.

⛳️ Requirements

• Over 10 years of experience in solutions architecture, data architecture, data engineering, enterprise storage, analytics platforms, or similar technical roles.

• Demonstrated experience in designing production data platforms.

• Capability to architect data platforms considering privacy, retention, audit, classification, policy enforcement, and regulatory factors.

• Skill in translating complex technical concepts into customer-facing guidance, reference architectures, and narratives suitable for executives.

• Practical experience in validating architectures within lab, proof-of-concept, or customer deployment settings.

• Ability to collaborate across engineering, product, field, partner, and customer teams.

• Profound understanding of data lakes, data lakehouse architectures, object storage, S3-compatible storage, governance, security, compliance, and auditability.

• Strong knowledge of Apache Iceberg, Parquet, and open table formats.

• Familiarity with metadata catalogs and their integration.

• Practical experience in constructing ETL, ELT, batch processing, and data preparation architectures.

• Production experience with Apache Spark, Kafka, Flink, Airflow, and Pentaho PDI.

• Extensive experience in cataloging, metadata management, data lineage, data quality, data classification, PII discovery, policy enforcement, auditability, retention, and compliance support.

• Knowledge of Collibra, Alation, Microsoft Purview, Informatica, DataHub, or OpenMetadata.

• Experience in supporting data foundations for AI, generative AI, analytics, and RAG pipelines.

• Understanding of vector embeddings, semantic metadata, metadata enrichment, AI governance, data preparation for AI, and vector databases.

• Experience with at least one modern lakehouse or federated query engine, such as Trino, Presto, Starburst, Athena, Snowflake, Databricks SQL, Dremio, Denodo, or similar federation platforms.

• Knowledge of data federation, data virtualization, predicate pushdown, query optimization, catalog integration, governance-aware query access, and compliance-aware data access controls.

🏝️ Benefits

• Employees can participate in Hitachi Vantara’s bonus/variable/commission pay programs where applicable.

• Industry-leading benefits, support, and services promoting holistic health and wellbeing.

• Flexible arrangements tailored to your needs (dependent on role and location).

• A sense of belonging, autonomy, freedom, and ownership.

• Reasonable accommodations provided during the recruitment process.