Senior Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Create, develop, and maintain scalable data pipelines and workflows utilizing Azure Databricks.

• Design and sustain SAS programs and SSIS packages for intermediate and downstream data processing.

• Construct, optimize, and uphold complex SQL queries for data transformation and analytical purposes.

• Architect and develop ETL/ELT pipelines that integrate various internal and external source systems.

• Choose, implement, and provide support for Big Data tools and frameworks.

• Oversee, troubleshoot, and resolve intricate data processing challenges using root cause analysis and preventive measures.

• Enhance data pipelines for performance, scalability, reliability, and cost-effectiveness.

• Propose and facilitate infrastructure enhancements to accommodate evolving data volumes and processing needs.

• Collaborate with product management and SRE teams to outline requirements and translate them into engineering tasks.

• Work in partnership with engineers, stakeholders, and cross-functional teams on data strategy, architecture, and outcomes.

• Contribute to data and software solutions that leverage big data, artificial intelligence, and machine learning to generate actionable insights.

⛳️ Requirements

• Bachelor's degree in a science, engineering, or computing-related field, or equivalent practical experience.

• Over 8 years of experience in designing and constructing production-grade batch data pipelines for data ingestion and transformation.

• More than 8 years of cumulative experience in data engineering or related positions.

• Strong expertise in SQL, Databricks, Python, Apache Spark, Git, and Azure Services including Synapse and Azure ADLS Gen 2.

• Solid understanding of relational database principles, data modeling, database management, and data warehousing.

• Proficient knowledge of Big Data querying tools.

• Experience in optimizing large-scale data pipelines and ETL workflows.

• Exceptional communication and interpersonal abilities.

• A minimum internet connection of 25 Mbps download and 10 Mbps upload is mandatory.

• A dedicated workspace free from ongoing interruptions to ensure the protection of member PHI/HIPAA information.

🏝️ Benefits

• Generous PTO package.

• Health benefits starting from day 1.

• Annual Incentive Plan.

• 401K with an excellent company match.

• Well-being program.

• Paid Volunteer Time Off.

• Medical, dental, and vision benefits.

• Paid time off, including company holidays and personal holidays.

• Paid parental and caregiver leave.

• Short-term and long-term disability coverage.

• Life insurance.

• Telephone equipment suitable to meet business requirements.

• Bi-weekly internet expense reimbursement for employees working from home in California, Illinois, Montana, or South Dakota.

• Occasional travel to Humana offices for training or meetings.