Data Engineer

This is a fully remote position, open to applicants in Wisconsin.

📋 Description

• Design, develop, and maintain scalable ETL/ELT pipelines and datasets using Databricks with Python, Spark, and SQL.

• Build and support batch and streaming data architectures for reporting, analytics, and AI/ML workloads.

• Diagnose and enhance Databricks and existing data integration processes to improve performance, reliability, and reduce data latency.

• Maintain and improve current SQL Server, SSIS, and SSRS solutions while aiding in the ongoing modernization of the platform.

• Implement data quality checks, validation, cleansing, and best practices for data warehousing across data pipelines and reporting environments.

• Integrate Databricks with enterprise applications, databases, and various other data sources.

• Collaborate with business users, analysts, and IT teams to convert reporting and data requirements into scalable technical solutions.

• Contribute to continuous improvement by leveraging emerging data engineering practices, AI-assisted development tools, documentation, and ongoing education.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Information Systems, or a related discipline.

• Extensive hands-on experience with Databricks, particularly with Python, Spark, and Delta Lake.

• Solid experience with SQL Server and data warehousing, including T-SQL.

• Familiarity with SSIS and SSRS.

• Experience with Microsoft Azure.

• Proficiency in using AI-assisted development tools within the engineering workflow.

• Strong analytical, problem-solving, communication, and teamwork abilities.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Generous paid time off and flexible work arrangements.

• Opportunities for professional development and training.

• Collaborative and inclusive work environment.