Data Architect – Data & AI Platforms, Databricks Focus

This is a fully remote position, open to applicants in Bulgaria.

📋 Description

• Spearhead the design and advancement of lakehouse-oriented data platforms utilizing Databricks and contemporary cloud technologies.

• Determine the processes for data ingestion, processing, governance, and consumption across batch, streaming, and AI workloads.

• Take ownership of architectural decisions pertaining to Delta Lake, data modeling, data pipelines, and the scalability of the platform.

• Serve as a trusted advisor to clients, assisting them in transforming legacy data environments into cloud-native, Databricks-powered platforms.

• Propel the architecture for comprehensive data solutions, covering ingestion (both batch and streaming) through to analytics, machine learning, and AI applications.

• Mentor teams in constructing robust Spark-based data pipelines and effective data processing frameworks.

• Establish best practices for data engineering utilizing Spark/PySpark; manage data governance through Unity Catalog; oversee data lifecycle and quality across the platform.

• Lead solution workshops, conduct technical deep-dives, and facilitate architecture sessions with both clients and internal teams.

• Provide support for pre-sales and solution shaping, particularly concerning Databricks-based architecture and delivery methodologies.

• Continuously enhance platform design by incorporating automation, DevOps practices, and reusable architectural patterns.

• Remain informed on Databricks innovations (DLT, Asset Bundles, Genie, ML/AI features) and integrate them into practical use cases.

⛳️ Requirements

• 8-10+ years of experience in Data Engineering, Data Architecture, or related roles.

• Strong practical experience with the Databricks platform (essential requirement), along with Apache Spark/PySpark.

• Expertise in data pipelines and distributed data processing.

• Demonstrated experience in designing and implementing lakehouse architectures (Delta Lake).

• Comprehensive experience with data modeling in large-scale analytical environments.

• Proficient in batch and streaming data processing.

• Strong background in cloud ecosystems (Azure preferred; AWS also relevant).

• Knowledge of data governance and security within modern platforms (e.g., Unity Catalog).

• Experience collaborating directly with clients in a consulting or advisory role.

• Capability to convert business requirements into scalable, cost-effective data solutions.

• Excellent communication skills and the ability to clarify complex architectural concepts.

🏝️ Benefits

• Health insurance

• Retirement plans

• Paid time off

• Flexible work arrangements

• Professional development

• Bonuses

• Stock options

• Equipment allowances

• Wellness programs