Solutions Architect

This is a fully remote position, open to applicants in New Mexico.

📋 Description

• Oversee and guarantee the timely achievement of precise technical project scopes.

• Manage technical specifications; define and supervise project deliverables, budgets, timelines, and risks.

• Assist and, in many instances, lead the project team in planning, monitoring, and executing scope from initiation to turnover.

• Provide guidance on the Databricks reference architecture encompassing Lakeflow, Delta Lake, Unity Catalog Mosaic AI, Databricks SQL, and Databricks Apps.

• Offer hands-on support in the design of full-stack solutions on Databricks.

• Advise on the design of data movement (e.g., batch, real-time streaming) and zero-copy patterns.

• Guide the migration of platforms from legacy SQL and document storage systems to Databricks and related cloud data platforms.

• Suggest security, governance, and compliance-as-code strategies: Unity Catalog ABAC, governed tags, row filters/column masks, key management, networking security, and compliance security profiles.

• Advise on the design of segregated/tiered data pool architectures that align with the organization's data classification policy and relevant regulatory requirements, including cross-tier data movement.

• Recommend FinOps and performance standards, as well as strategies for workload and cost management.

• Mentor data engineers, analysts, and AI/ML teams, participate in architecture reviews, and contribute to standards.

• Collaborate with information & cyber security and other teams as necessary to ensure compliance with policies and standards.

• Assess emerging Databricks capabilities and propose adoption strategies, including integrations with third-party endpoints as they develop.

⛳️ Requirements

• Master’s Degree in a relevant field of study. (required)

• A minimum of 15 years of relevant experience or an equivalent combination of education and experience. (required)

• Over 7 years of experience designing, building, and managing Databricks workloads utilizing medallion layer architecture.

• Practical experience with Delta Lake, Unity Catalog, Spark Structured Streaming, Lakeflow (or DLT/Live Tables), Databricks SQL, MLflow, and Mosaic AI Model Serving.

• Strong background in cloud architecture supporting the platform (VPC/VNet, Security, S3/ADLS, KMS, etc.).

• Demonstrated experience in migrating enterprise data workloads from legacy/on-premises data warehouses/lakes to Databricks.

• Experience in production streaming and Change Data Capture (CDC).

• Expertise in security and governance: Unity Catalog policies (ABAC), classification, encryption, access auditing, and compliance-to-control translation.

• Hands-on experience in designing multi-tier Databricks architectures driven by data classification requirements.

• Proficient in Python, SQL, Spark, and Notebooks.

• Exceptional verbal and written communication abilities.

• Must be a U.S. Citizen to fulfill federal contract security requirements (required).

• Capability to successfully pass a federal background investigation to obtain and maintain DOE Q security clearance (required).

🏝️ Benefits

• Competitive salary and benefits.

• Well-being programs designed to support you and your family.