Senior Databricks Engineer – GenAI, Genie

Posted 11 hours ago

This is a fully remote position, open to applicants in Poland, +2 more countries.

📋 Description

• Design, configure, and manage high-performance Databricks Genie Spaces tailored for intricate business domains.

• Develop semantic metadata, SQL queries, and golden instructions to facilitate precise and deterministic SQL generation.

• Evaluate, benchmark, and refine Genie responses for sophisticated business logic, edge cases, and multi-turn dialogues.

• Integrate Databricks Genie endpoints with custom web interfaces and external user interfaces.

• Establish feedback mechanisms to perpetually enhance Genie’s accuracy.

• Construct and optimize data pipelines using Python, SQL, and PySpark.

• Organize and optimize Delta Lake data for efficient Genie utilization.

• Leverage LLMs on Databricks for enriching metadata, automating data labeling, and optimizing semantics.

• Convert business users' inquiries into schemas and semantic data models that Genie can effectively utilize.

• Collaborate with Databricks MVPs, core product teams, engineering teams, business stakeholders, and clients.


⛳️ Requirements

• Over 5 years of practical experience within the Databricks ecosystem.

• A specific emphasis on Databricks Genie or similar Text-to-SQL/semantic layer roles.

• Familiarity with Unity Catalog and Databricks SQL/Workflows.

• Advanced SQL expertise, including the ability to write complex, high-performing queries.

• Experience in structuring data using star schemas, gold tables, and views to ensure Genie readiness.

• Strong proficiency in writing clean, production-quality Python code.

• Comprehensive understanding of Text-to-SQL paradigms, prompt engineering, semantic routing, and RAG architectures.

• Proficient in Apache Spark and PySpark for data transformation and orchestration tasks.

• Experience with REST APIs for integrating GenAI endpoints into external applications.

• Exceptional analytical skills and attention to detail when reviewing generated SQL for business accuracy.

• Ability to effectively communicate with business stakeholders and translate business terminology into semantic data models.

• A passion for staying updated with Databricks and GenAI product developments.

• Experience with MLflow and Databricks Model Serving is a plus.


🏝️ Benefits

• Employment Contract (UoP) or B2B options available in Poland; B2B only in Romania and Greece.

• 100% remote work flexibility, allowing you to work from anywhere in Poland, Romania, or Greece.

• An Apple MacBook Air M4 15" will be provided.

• Referral bonuses for introducing other top-tier engineers.

• Coverage for all Databricks technical certification costs.

• Support towards achieving the highest levels of Databricks expertise, including the Champion program.

• Opportunities to present at global industry conferences and contribute to technical thought leadership.

• Direct collaboration with Databricks MVPs and core product teams.

• Daily overlap with US time zones for team synchronization and collaborative efforts.

• Travel opportunities to the US for client meetings.

People also viewed

Supermove10 hours ago

Professional Services Engineer

US flagUnited States, +1 more countryFull-timeEngineer
ApplyView job
Pythagoras AI10 hours ago

Forward Deployed Engineer

US flagUnited States OnlyFull-timeEngineer
ApplyView job
Koch11 hours ago

Asset Process Engineer – Lumber

GE flagGeorgia OnlyFull-timeEngineer$100k – $110k/year
ApplyView job
RTX11 hours ago

Mobility Engineer

US flagConnecticut OnlyFull-timeEngineer$107.5k – $204.5k/year
ApplyView job
Koch11 hours ago

Asset Process Engineer – Lumber

GE flagGeorgia OnlyFull-timeEngineer$100k – $110k/year
ApplyView job
The Home Depot11 hours ago

Logistics Engineer

GE flagGeorgia OnlyFull-timeEngineer$50k – $130k/year
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers