Application Data Developer – Expert

This is a fully remote position, open to applicants in Nebraska.

📋 Description

• Take ownership of the Scala/Spark application framework that supports Medicaid Encounter Processing.

• Manage the implementation and ongoing maintenance of Drools business rules.

• Lead enterprise data ingestion processes for master data and source system files.

• Oversee Spark and Hive batch processing workflows.

• Investigate production issues and resolve application defects.

• Coordinate production releases, manage versioning, and oversee deployment processes.

• Optimize and tune application performance.

• Create and maintain technical documentation, operational procedures, and facilitate knowledge transfer.

• Provide basic operational administration and monitoring of the Cloudera Data Platform while collaborating with infrastructure and cloud operations teams.

• Enhance, support, and maintain Nebraska's enterprise data processing framework.

• Implement necessary business and regulatory changes.

• Support production operations and conduct routine administration of the data processing environment.

⛳️ Requirements

• At least 7 years of experience in developing enterprise-scale distributed data processing applications.

• Significant hands-on development experience with Scala.

• Experience in developing applications using Apache Spark 2.x and/or Spark 3.x.

• Proficiency in developing and maintaining applications on Cloudera Data Platform (CDP) 7.x or equivalent enterprise Hadoop distributions.

• Familiarity with Apache Hive 3.x for data processing and managing Hive tables.

• Experience in implementing business rules using the Drools Rules Engine.

• Strong skills in SQL development and query optimization.

• Experience supporting production environments based on Linux.

• Expertise in troubleshooting distributed Spark applications in production settings.

• Proficient in using Git and modern version control practices.

• Experience in the Medicaid or healthcare sector is preferred.

• Previous experience with Medicaid Encounter Processing is a plus.

• Familiarity with Cloudera Manager, HDFS, and YARN is preferred.

• Experience integrating with IBM DataStage is advantageous.

• Knowledge of AWS infrastructure supporting Cloudera is preferred.

• Familiarity with Agile methodologies, Jira, and Confluence is preferred.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Retirement savings plan with employer matching.

• Opportunities for professional development and continuous learning.

• Flexible working hours and remote work options.