Lead Data Engineer, Data Platform – IntelliScript

📋 Description

• Acts as a subject matter expert and thought leader within the Data Platform Domain.

• Provides guidance in data processing design and implementation, establishing advanced frameworks for the movement, storage, and maintenance of high-quality data.

• Oversees projects by managing timelines, coordinating teams, and communicating project progress.

• Serves as an expert on governance standards, continuously aligning data practices with the latest industry best practices and requirements.

• Contributes to the formulation of the overall vision and strategy for data engineering within the organization, ensuring alignment with organizational goals and long-term objectives.

• Establishes visionary goals, advises on strategic plans, utilizes advanced monitoring, influences high-level stakeholders, and delivers transformative results.

• Drives the expansion of our Data Warehouse(s) and Lakehouse solutions for a healthcare data-focused enterprise.

• Configures and maintains a unity catalog to facilitate enterprise data lineage, data quality, auditability, and data stewardship.

• Develops data security protocols and best practices, including the management of identified and de-identified (PHI/PII) solutions.

• Consistently ensures adherence to a policy of least privilege for all implementations.

• Creates data solutions for clients while maintaining the highest standards for reliability, quality, and performance.

• Constructs solutions within Delta Live Tables and automates transformations.

• Develops efficient enterprise-level medallion architecture(s).

• Creates purpose-built near real-time streaming and batch solutions.

• Designs efficient enterprise solutions for both structured and unstructured healthcare data, catering to internal and external users.

• Builds Infrastructure as Code utilizing Terraform and Asset Bundles.

• Collaborates with the business to develop cost-effective and transparent data solutions.

• Assists in architecting, building, and maintaining robust and scalable data pipelines, while monitoring and optimizing performance.

• Identifies and implements enhancements to improve data processing efficiency.

• Designs and applies reliable and resilient Event Driven data processing.

• Leads the design, implementation, and maintenance of standards-based (FHIR, OMOP, etc.) and efficient data models for both structured and unstructured data.

• Assembles large, complex data sets that meet both functional and non-functional business requirements.

• Develops and maintains data models, ensuring alignment with business objectives and data privacy regulations.

• Partners internally and externally with key stakeholders to ensure the delivery of meaningful, functional, and valuable data.

• Effectively collaborates with Data, Development, Analysts, Data Science, and Business team members to gather requirements, propose, and build solutions.

• Communicates complex technical concepts to non-technical stakeholders and offers guidance on best practices.

• Ensures technology execution aligns with business strategy, providing efficient and secure solutions and systems.

• Gathers requirements and creates project plans to implement those requirements with forecasted efforts.

• Identifies, designs, and implements internal process improvements, including automating manual processes, optimizing data delivery, and redesigning infrastructure for enhanced scalability.

• Develops analytics tools that leverage the data pipeline to deliver actionable insights into operational efficiency and other key business performance metrics.

• Creates data tools for clinical, analytics, and data science team members to assist in building and optimizing our product into an innovative industry leader.

• Leads the investigation of new tools, develops implementation plans, and oversees the deployment of necessary tools.

⛳️ Requirements

• Over 10 years of relevant experience in the design, development, and testing of Data Platform solutions, including Data Warehouses, Data Lakes, and Data Products.

• Expert-level experience with Databricks and AWS.

• Advanced knowledge of both relational and non-relational databases, such as SQL Server, PostgreSQL, DynamoDB, and DocumentDB.

• Experience in managing and standardizing clinical data from both structured and unstructured sources.

• Proven experience in building and managing solutions on AWS.

• In-depth knowledge of healthcare standards, including FHIR, C-CDA, and traditional HL7.

• Comprehensive understanding of clinical standards/ontologies such as ICD10/SNOMED/NDC/LOINC/Rx Norm.

• Expertise in developing data models, data warehouses, and designing data lakes for enterprise and product use cases.

• Familiarity with designing and building APIs, ETL processes, and data ingestion methodologies to support enterprise solutions.

• Experience in performance tuning, query optimization, security, monitoring, and release management.

• Experience managing large, disparate, identified, and de-identified data sets from multiple sources.

• Proficient in building and deploying Infrastructure as Code using Terraform, asset bundles, and GitHub.

• Experience collaborating with Data Science teams and creating AI-based solutions to enhance efficiencies and business value.

🏝️ Benefits

• Medical, Dental, and Vision – Coverage for employees, dependents, and domestic partners.

• Employee Assistance Program (EAP) – Confidential support for personal and work-related challenges.

• 401(k) Plan – Includes a company matching program and profit-sharing contributions.

• Discretionary Bonus Program – Acknowledging employee contributions.

• Flexible Spending Accounts (FSA) – Pre-tax savings for dependent care, transportation, and qualifying medical expenses.

• Paid Time Off (PTO) – Begins accruing on the first day of work. Full-time employees accrue 15 days per year, with prorated accrual for part-time employees.

• Holidays – A minimum of 10 paid holidays per year.

• Family Building Benefits – Including adoption and fertility assistance.

• Paid Parental Leave – Up to 12 weeks of paid leave for eligible employees.

• Life Insurance & AD&D – 100% of premiums covered by Milliman.

• Short-Term and Long-Term Disability – Fully paid by Milliman.