Senior Data Engineer

This is a fully remote position, open to applicants in India.

📋 Description

• Collaborate with the Team Lead and cross-functional teams to collect and refine data requirements for Denials AI solutions.

• Design, implement, and enhance ETL/ELT pipelines utilizing Python, Dagster, DBT, and AWS data services such as Athena, Glue, and SQS.

• Develop and sustain data models in PostgreSQL; write efficient SQL for querying and optimizing performance.

• Monitor the health and performance of pipelines; troubleshoot data incidents and apply preventive measures.

• Enforce data quality and governance standards, ensuring compliance with HIPAA regulations regarding PHI handling.

• Conduct code reviews, share best practices, and provide mentorship to junior data engineers.

• Automate deployment and monitoring tasks through infrastructure-as-code and AWS CloudWatch metrics and alarms.

• Document data workflows, schemas, and operational runbooks to facilitate team knowledge transfer.

⛳️ Requirements

• Bachelor's or master's degree in Computer Science, Data Engineering, or a related field.

• Over 5 years of practical experience in building and operating production-grade data pipelines.

• Strong experience with workflow orchestration tools (Dagster) and transformation frameworks (DBT) or similar tools such as Microsoft SSIS, AWS Glue, and Air Flow.

• Proficient SQL skills on PostgreSQL for data modeling and query optimization or other comparable technologies (Microsoft SQL Server, Oracle, AWS RDS).

• Familiarity with AWS data services: Athena, Glue, SQS, SNS, IAM, and CloudWatch.

• Basic knowledge of Python and Python data frameworks (Pandas, PySpark).

• Experience with version control systems (GitHub) and CI/CD processes for data projects.

• Understanding of healthcare data standards and HIPAA compliance.

• Experience in mentoring or leading small technical initiatives.

• Proficient in Microsoft Office Suite.

• Excellent interpersonal skills, with the ability to communicate effectively across all organizational levels.

• Strong problem-solving and creative abilities, with sound judgment to make decisions based on timely and accurate analyses.

• High level of integrity and reliability, paired with a strong sense of urgency and results-oriented mindset.

• Exceptional written and verbal communication skills are essential.

🏝️ Benefits

• Competitive salary with performance-based incentives.

• Comprehensive health, dental, and vision insurance plans.

• Opportunities for professional growth and development.

• Flexible work arrangements and a supportive work environment.

• Generous paid time off and holiday policies.