Principal Azure Data Engineer, Python, PySpark, SQL, DataBricks

This is a fully remote position, open to applicants in India.

📋 Description

• Create and improve Databricks pipelines while enhancing existing ones.

• Work with crucial business data, maintaining close communication with business stakeholders.

• Implement data engineering best practices to develop high-quality, reliable, and user-friendly data models.

• Define and execute new entities for the all-encompassing data model.

• Engage with business clients to gather requirements and create new datasets.

• Quickly identify and resolve data quality issues.

• Extract and integrate data from a variety of data sources.

• Design, implement, and maintain a platform that provides on-demand access to large datasets.

• Model both data and metadata to facilitate machine learning and AI initiatives.

• Assist with integration activities related to acquisitions as needed.

• Collaborate with product teams, data engineers, and clinical leaders to deliver data products for both internal and external clients.

⛳️ Requirements

• A Bachelor's degree in computer science, information technology, or a related discipline is required.

• A solid understanding of database structures, theories, principles, and practices is essential.

• Proficiency in Python, Spark, and SQL is required.

• Proven experience with software development life cycle best practices, including documentation, coding standards, code reviews, source control management, deployment workflows, testing, and operations.

• Familiarity with normalized, dimensional, star schema, and snowflake schema data models is necessary.

• Experience in the healthcare domain and working with data is preferred.

• Prior experience with Databricks is advantageous.

• Databricks/Microsoft Azure Certification is considered a plus.

• Excellent written and verbal communication skills are required.

• A minimum of 10 years of experience working with various healthcare data sources, including claims, encounters, ADT data, FHIR, and EHR data.

• At least 8 years of experience utilizing cloud-based services from AWS, GCP, or Azure.

• Strong debugging skills in SQL and Spark are required.

• Capability to function effectively as an independent contributor.

🏝️ Benefits

• Stock options are available.

• Options for remote work.

• Flexible working hours are offered.

• Benefits that exceed legal requirements.

• Opportunities to collaborate with IT professionals.

• Mentorship and chances for professional growth and development.