Staff Data Engineer, Data Platform – IntelliScript

This is a fully remote position, open to applicants in United States.

📋 Description

• Serve as a subject matter expert and thought leader in the Data Platform domain.

• Design complex data processing frameworks and structures for the movement, storage, and maintenance of high-quality data.

• Lead projects by overseeing timelines, coordinating teams, and communicating project updates.

• Shape organizational direction through leadership and strategic collaboration.

• Establish and align data governance standards with industry best practices and regulatory requirements.

• Define the vision and strategy for data engineering within the organization.

• Expand data warehouses and Lakehouse solutions tailored for a healthcare data-focused enterprise.

• Configure and maintain Unity Catalog for data lineage, quality, auditability, and stewardship.

• Develop data security protocols and solutions for both identified and de-identified PHI/PII.

• Enforce least-privilege access management practices.

• Create reliable, high-quality, and efficient external data products for clients.

• Develop ETL solutions using Delta Live Tables and automate data transformations.

• Design enterprise medallion architectures.

• Build near-real-time streaming solutions and batch processing systems.

• Create scalable solutions for both structured and unstructured healthcare data.

• Implement Infrastructure as Code using Terraform and Asset Bundles.

• Collaborate with the business to develop cost-effective and transparent data solutions.

• Architect, build, maintain, monitor, and optimize robust data pipelines.

• Establish data extraction, transformation, and loading infrastructure utilizing SQL, Delta Live Tables, Python, Scala, and cloud-based big-data technologies.

• Design and implement internal APIs for data integration.

• Integrate external systems via API-driven ingestion methodologies.

• Develop APIs on Databricks datasets for internal system utilization.

• Integrate with external APIs such as Salesforce, financial systems, HR systems, and others.

• Lead the design, implementation, and maintenance of standards-based data models such as FHIR and OMOP.

• Assemble complex datasets that meet both functional and non-functional business requirements.

• Maintain data models that are aligned with business objectives and privacy regulations.

• Partner with internal and external stakeholders to deliver meaningful and valuable data.

• Gather requirements, propose solutions, create project plans, and estimate implementation efforts.

• Communicate complex technical concepts to non-technical stakeholders and provide best-practice guidance.

• Identify and implement process improvements, automation, infrastructure redesign, and scalability enhancements.

• Develop analytics tools aimed at operational efficiency and business performance insights.

• Create data tools for clinical, analytics, and data science teams.

• Explore new tooling, develop implementation plans, and deploy necessary technologies.

• Educate and mentor others on emerging technologies.

⛳️ Requirements

• Over 15 years of relevant experience in designing, developing, and testing Data Platform solutions.

• Expert-level experience with Databricks and AWS.

• Extensive experience with relational and non-relational databases, including SQL Server, PostgreSQL, DynamoDB, and DocumentDB.

• Proven experience managing and standardizing clinical data from both structured and unstructured sources.

• Background in building and managing solutions on AWS.

• In-depth knowledge of healthcare standards such as FHIR, C-CDA, and traditional HL7.

• Expertise in clinical standards and ontologies including ICD10, SNOMED, NDC, LOINC, and RxNorm.

• Strong background in data models, data warehouses, and enterprise/product data lakes.

• Familiarity with APIs, ETL processes, data ingestion methodologies, and enterprise tooling.

• Experience in performance tuning, query optimization, security, monitoring, and release management.

• Proven track record of managing large, disparate datasets, both identified and de-identified, from multiple sources.

• Experience in building and deploying Infrastructure as Code using Terraform, Asset Bundles, and GitHub.

• Experience collaborating with Data Science teams and developing AI-based solutions.

• Strong ability to collaborate and communicate across both technical and non-technical disciplines.

• Capability to navigate through ambiguous situations.

• Ability to teach and mentor others on emerging technologies.

• Customer- and business-focused approach.

• Ability to balance strategic and tactical needs effectively.

• Driven, thorough, and self-directed individual.

• Ability to lead through influence and persuasion.

• Bachelor's or master's degree in computer science, data engineering, or a related field (preferred, not required).

• Experience in the Health and Life Insurance business (preferred).

• Professional-level AWS solution architecture certification (preferred).

🏝️ Benefits

• Comprehensive Medical, Dental, and Vision coverage for employees, dependents, and domestic partners.

• Employee Assistance Program (EAP).

• 401(k) Plan featuring company matching and profit-sharing contributions.

• Discretionary Bonus Program.

• Flexible Spending Accounts (FSA).

• Paid Time Off (PTO): full-time employees accrue 15 days annually.

• A minimum of 10 paid holidays each year.

• Family Building Benefits, including assistance for adoption and fertility.

• Up to 11 weeks of paid parental leave for eligible employees.

• Life Insurance & AD&D with 100% of premiums covered by Milliman.

• Short-Term and Long-Term Disability fully covered by Milliman.

• Opportunity for remote work from anywhere in the US.

• Access to skills training, career development, learning, and mentoring opportunities.

• Participation in Employee Resource Groups (ERGs).