Principal Architect – Databricks

This is a fully remote position, open to applicants in Texas.

📋 Description

• Design enterprise data warehousing (EDW), lakehouse, and business intelligence (BI) systems utilizing Databricks.

• Construct scalable data pipelines using Azure Hub, Device SDK, DPS, and Stream Analytics.

• Implement information lifecycle management (ILM) from data ingestion through to archiving.

• Establish, develop, and uphold global data governance and master data management standards.

• Extract and transform unstructured data into interconnected datasets for enhanced analytics.

⛳️ Requirements

• Core Cloud Data Platform expertise (Must Have)

• Databricks: Strong skills in creating optimized Spark pipelines, Delta Lakes, and Lakehouses.

• Cloud Ecosystem (Option A: Azure Suite)

• IoT Infrastructure: Proficiency with Azure Hub, Device SDK, Device Provisioning Services (DPS), and Device Twins.

• Compute & Storage: Experience with Azure Functions, Cosmos DB, and Azure Stream Analytics.

• Cloud Ecosystem (Option B: AWS Alternative)

• IoT Infrastructure: Knowledge of AWS IoT Core, IoT Device Management, and IoT Device Defender.

• Compute & Storage: Familiarity with AWS Lambda, DynamoDB, Amazon Kinesis, and EMR.

• Data Engineering & Governance expertise.

• BI & EDW: Extensive knowledge in enterprise data warehousing and business intelligence tools.

• Data Modeling: Proven capability to manage both structured and unstructured data assets.

• Preferred: Experience in architecting and constructing Azure IoT platforms/apps with exposure to containerization and serverless architecture.

🏝️ Benefits

• Significant opportunities for career development as the company expands.

• Unique chance to be part of a small, challenging, and entrepreneurial environment.

• High level of individual responsibility.

• Equal employment opportunities for applicants and employees, irrespective of race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, national origin, ancestry, marital status, protected veteran status, disability status, or any other basis protected by federal, state, or local law.