
Senior Databricks Engineer – GenAI, Genie
Posted 11 hours ago

Posted 11 hours ago
This is a fully remote position, open to applicants in Poland, +2 more countries.
• Design, configure, and manage high-performance Databricks Genie Spaces tailored for intricate business domains.
• Develop semantic metadata, SQL queries, and golden instructions to facilitate precise and deterministic SQL generation.
• Evaluate, benchmark, and refine Genie responses for sophisticated business logic, edge cases, and multi-turn dialogues.
• Integrate Databricks Genie endpoints with custom web interfaces and external user interfaces.
• Establish feedback mechanisms to perpetually enhance Genie’s accuracy.
• Construct and optimize data pipelines using Python, SQL, and PySpark.
• Organize and optimize Delta Lake data for efficient Genie utilization.
• Leverage LLMs on Databricks for enriching metadata, automating data labeling, and optimizing semantics.
• Convert business users' inquiries into schemas and semantic data models that Genie can effectively utilize.
• Collaborate with Databricks MVPs, core product teams, engineering teams, business stakeholders, and clients.
• Over 5 years of practical experience within the Databricks ecosystem.
• A specific emphasis on Databricks Genie or similar Text-to-SQL/semantic layer roles.
• Familiarity with Unity Catalog and Databricks SQL/Workflows.
• Advanced SQL expertise, including the ability to write complex, high-performing queries.
• Experience in structuring data using star schemas, gold tables, and views to ensure Genie readiness.
• Strong proficiency in writing clean, production-quality Python code.
• Comprehensive understanding of Text-to-SQL paradigms, prompt engineering, semantic routing, and RAG architectures.
• Proficient in Apache Spark and PySpark for data transformation and orchestration tasks.
• Experience with REST APIs for integrating GenAI endpoints into external applications.
• Exceptional analytical skills and attention to detail when reviewing generated SQL for business accuracy.
• Ability to effectively communicate with business stakeholders and translate business terminology into semantic data models.
• A passion for staying updated with Databricks and GenAI product developments.
• Experience with MLflow and Databricks Model Serving is a plus.
• Employment Contract (UoP) or B2B options available in Poland; B2B only in Romania and Greece.
• 100% remote work flexibility, allowing you to work from anywhere in Poland, Romania, or Greece.
• An Apple MacBook Air M4 15" will be provided.
• Referral bonuses for introducing other top-tier engineers.
• Coverage for all Databricks technical certification costs.
• Support towards achieving the highest levels of Databricks expertise, including the Champion program.
• Opportunities to present at global industry conferences and contribute to technical thought leadership.
• Direct collaboration with Databricks MVPs and core product teams.
• Daily overlap with US time zones for team synchronization and collaborative efforts.
• Travel opportunities to the US for client meetings.
Supermove
Pythagoras AI
Koch
RTX
Get handpicked remote jobs straight to your inbox weekly.