Senior Data Engineer

This is a fully remote position, open to applicants in Minnesota, +1 more state.

📋 Description

• Develop traditional code and server-less functions utilizing the most appropriate language for the task, primarily focusing on Scala, and may also involve C# and SQL.

• Create APIs, data microservices, and ETL pipelines to facilitate data sharing with internal and external partners, as well as write interfaces for public datasets to enhance our analytics data repositories.

• Design and refine processes for optimizing large language models (LLMs) and implementing Retrieval-Augmented Generation (RAG) frameworks to improve AI-driven solutions.

• Engage in fostering and maintaining a culture of DevOps and Quality Assurance.

• Consistently document code, framework standards, and team processes.

• Construct and maintain Data Ingestion frameworks deployed within Azure.

• Perform additional duties and responsibilities as assigned.

⛳️ Requirements

• A Bachelor’s degree in Computer Science, Computer Engineering, Information Systems, or equivalent experience is required.

• Approximately five (5) years of experience in an enterprise or commercial software development setting, with a strong preference for a background in Healthcare IT.

• Proven enterprise development experience in coding with Scala.

• Proficiency in building both batch and streaming data pipelines using Scala.

• Familiarity with API design is essential.

• Significant experience in developing data-centric solutions within a Cloud environment.

• Extensive background in creating solutions that leverage event sourcing and/or Big Data architectures.

• Experience in engineering big-data solutions utilizing technologies such as Databricks, Hive, and Spark.

• Competence in functional programming using Scala and C#.

• Proven experience in building distributed systems with microservices and/or service-oriented architectures.

• Experience operating within an Azure environment.

🏝️ Benefits

• Health insurance

• Retirement plans

• Professional development