Senior Database Engineer

This is a fully remote position, open to applicants in India.

📋 Description

• Design, develop, optimize, and enhance modern Microsoft data platforms utilizing Azure and Microsoft Fabric.

• Take ownership of cloud data engineering, enterprise warehouse, and lakehouse architecture, as well as data integration, semantic consumption, and AI-ready data products.

• Create scalable Fabric Lakehouse, Fabric Warehouse, and hybrid warehouse architectures featuring raw, standardized, curated, and consumption-ready layers.

• Develop dimensional models, star schemas, facts, dimensions, data marts, semantic-ready datasets, and reusable data products.

• Construct production ETL/ELT processes using Fabric Data Factory, Azure Data Factory, SQL, Python, PySpark, notebooks, APIs, files, and event or batch integration patterns.

• Engineer solutions aligned with OneLake, including shortcuts, pipelines, notebooks, SQL endpoints, Power BI semantic models, and Direct Lake patterns.

• Establish governed data foundations for generative AI, copilots, agents, search, and analytics utilizing Microsoft Foundry, Azure OpenAI, Azure AI Search, and enterprise data sources.

• Design and implement RAG workflows encompassing ingestion, chunking, metadata, embeddings, vector/hybrid retrieval, grounding, prompt design, citations, and evaluation.

• Assess LLM solution quality, grounding, latency, cost, content safety, data leakage risk, and business suitability prior to production deployment.

• Leverage enterprise copilots to expedite development and create user-facing experiences.

• Employ responsible AI practices, including human review, access controls, privacy protections, prompt and model testing, auditability, and monitoring.

• Enforce data quality, lineage, observability, reconciliation, validation, security, and governance measures.

• Utilize Git, pull requests, automated testing, CI/CD, environment promotion, and Infrastructure as Code.

• Optimize workloads for performance, scalability, reliability, and cost across SQL, Spark, Fabric capacity, storage, pipelines, and semantic models.

• Collaborate with BI, analytics, application engineering, DBAs, security, infrastructure, and business stakeholders on comprehensive solution architecture.

• Provide technical leadership through code and design reviews, reusable templates, technical documentation, and mentorship.

⛳️ Requirements

• A minimum of 7 years of professional experience in data engineering, database engineering, data warehousing, or a closely related field, including senior-level design ownership.

• Hands-on experience with Azure data services and Microsoft Fabric or equivalent Microsoft cloud lakehouse/warehouse technologies in production settings.

• Proficient in advanced SQL and have a solid understanding of relational design, dimensional modeling, data warehousing, data marts, and performance engineering.

• Experience in constructing and managing ETL/ELT pipelines using SQL, Python or PySpark, notebooks, APIs, files, orchestration, and incremental processing patterns.

• Practical AI/LLM experience, including the implementation of at least one Copilot, chatbot, agent, RAG, intelligent search, or LLM-enabled data solution.

• Familiarity with prompt engineering, grounding, embeddings, vector or hybrid retrieval, model evaluation, responsible AI, security, and observability.

• Experienced with Git, pull requests, automated testing, CI/CD, environment promotion, and repeatable deployment practices.

• Strong comprehension of identity, cloud security, data governance, privacy, data quality, lineage, and operational support.

• Excellent written and verbal communication skills with both technical and non-technical stakeholders.

• Capability to mentor team members, lead design or incident reviews, and document repeatable standards.

• A commitment to security, data privacy, responsible technology usage, and ongoing learning.

🏝️ Benefits

• Equal opportunity employment.

• Permanent employment contract.