Data Engineer, AI

📋 Description

• Develop, maintain, and execute intermediate to advanced Spark scripts for managing data, validating data, and integrating data.

• Design, maintain, and execute basic to intermediate SQL scripts for data management and validation.

• Enhance query performance to boost the efficiency of daily operations.

• Conduct data analysis and pinpoint any discrepancies.

• Collaborate with teams such as Engineering, DBA, and Cloud Operations to diagnose and resolve environmental or network issues that may affect your work.

• Provide support during after-hours or weekends as required.

• Create and sustain data pipelines as necessary.

• Validate task outcomes to ensure compliance with all requirements.

• Follow all industry and organizational compliance guidelines to uphold data integrity.

• Track individual productivity metrics.

• Complete task assignments using the department's ticketing system within designated deadlines.

• Meet organizational and personal objectives as outlined in performance reviews and goal-setting sessions.

• Carry out all special projects and other assigned responsibilities.

⛳️ Requirements

• Bachelor's degree in Computer Science, Information Technology, or equivalent professional experience.

• Over 6 years of hands-on experience with big data technologies (Spark, S3, Kafka, Ray, Hadoop, etc.).

• More than 6 years of experience with cloud platforms (Databricks, AWS, Azure, GCP, OCI, etc.).

• At least 6 years of experience with RDBMS (Oracle, MS SQL, Vertica, etc.) and proficiency in SQL, PL/SQL, or other data integration/ETL tools.

• 6+ years of data analysis experience.

• Preferably experience in the Healthcare sector, including enrollment, medical claims, and/or pharmacy claims.

• Familiarity with Databricks and/or Snowflake environments is a significant advantage.

• Proficient in Microsoft Office Suite applications, including PowerPoint, Word, Excel, and Outlook.

• Flexible work schedule.

• Experience with project management tools such as JIRA.

• Strong analytical capabilities.

• Excellent verbal, listening, and written communication skills.

🏝️ Benefits

• Medical, dental, vision, disability, and life insurance coverage.

• 401(k) savings plans.

• Paid family leave.

• 9 paid holidays annually.

• 17-27 days of Paid Time Off (PTO) each year, depending on specific level and length of service with Cotiviti.