Senior Data and AI Platform Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, develop, and sustain data platforms and pipelines that facilitate analytics, data science, business intelligence, and artificial intelligence.

• Spearhead the advancement of Jellyfish’s Databricks Lakehouse platform.

• Enable organization-wide agentic analytics within Databricks utilizing reliable datasets.

• Assist in enhancing core capabilities of the Databricks platform, including Unity Catalog and platform observability.

• Construct and oversee ingestion pipelines for high-value data.

• Collaborate on data flows that transmit trustworthy data to various internal systems.

• Work together with stakeholders to grasp analytical requirements and devise platform solutions.

• Establish standards and reusable frameworks for data modeling, documentation, testing, and governance.

• Create tools and processes to assess data platform health, pipeline reliability, cost efficiency, performance, and usage.

• Provide technical guidance as a senior individual contributor.

⛳️ Requirements

• Extensive experience in data engineering, data platform engineering, analytics engineering, or similar fields.

• Designed, built, and managed dependable data platforms or large-scale data pipelines in a production environment.

• Proficient experience with Databricks or analogous lakehouse/data platform technologies.

• Comprehend how to construct governed, well-structured data assets that support business intelligence, analytics, data science, and AI initiatives.

• Familiarity with data ingestion, transformation, orchestration, testing, monitoring, and data quality methodologies.

• Advanced SQL expertise and experience with various database and warehouse technologies.

• Strong programming skills, particularly in Python or related languages.

• Comfortable interacting with both technical and non-technical stakeholders.

• Excellent communication abilities and a passion for being part of a cross-functional team.

🏝️ Benefits

• Offers Equity