Solutions/Data Bricks Architect

This is a fully remote position, open to applicants in United States.

📋 Description

• Create and execute enterprise data lakehouse architectures utilizing Databricks.

• Build scalable ETL pipelines, data integrations, and solutions for real-time data processing.

• Drive optimization of the Databricks platform, encompassing Delta Lake, Databricks SQL, and Apache Spark workloads.

• Ensure adherence to federal security and governance regulations, including FedRAMP, FISMA, and NIST standards.

• Work collaboratively with stakeholders to determine business requirements and convert them into technical solutions.

• Connect Databricks with AWS GovCloud, Azure Government, or other federal cloud systems.

• Facilitate advanced analytics, reporting, and machine learning projects using MLflow and associated technologies.

• Offer technical leadership, mentorship, and guidance on best practices to engineering teams.

⛳️ Requirements

• Over 5 years of experience in data engineering, data architecture, or large-scale data platforms.

• At least 3 years of practical experience with Databricks.

• Extensive knowledge of the Databricks Lakehouse Platform, Delta Lake, Databricks SQL, Apache Spark, and programming languages such as Python, Scala, or Java.

• Familiarity with cloud platforms that support federal environments, including AWS GovCloud and Azure Government.

• In-depth understanding of ETL development, data modeling, data lakes, and data warehousing.

• Background in implementing security, governance, and compliance measures in regulated environments.

• Advanced SQL proficiency and experience in managing large datasets.

• Excellent communication and stakeholder engagement abilities.

• Must be eligible to obtain and maintain a Public Trust clearance or higher.

• Preferred: Experience with CI/CD pipelines and Infrastructure as Code (Terraform, CloudFormation, ARM).

• Preferred: Knowledge of streaming technologies such as Kafka, Azure Event Hubs, AWS Kinesis, or others.

• Preferred: Experience with machine learning frameworks including TensorFlow, PyTorch, Scikit-learn, and MLflow.

• Preferred: Familiarity with Big Data technologies like Hadoop, Flink, Elasticsearch, or others.

• Preferred: Databricks Certified Professional Data Engineer or similar certifications.

• Preferred: Federal cloud and cybersecurity certifications (CISSP, CCSP, CISM, AWS Security Specialty).

• Preferred: Previous experience in federal consulting supporting mission-critical data initiatives.

🏝️ Benefits

• Benefits available.

• Equal Employment Opportunity / Affirmative Action employer.