Data Engineer, Azure, Fabric, Databricks

This is a fully remote position, open to applicants in Illinois.

📋 Description

• Design and develop contemporary data platforms utilizing Microsoft Fabric and Databricks.

• Construct and enhance data ingestion, transformation, and orchestration pipelines by applying ELT/ETL best practices.

• Create scalable lakehouse architectures for analytics, reporting, and downstream data products.

• Convert business and analytical needs into technical designs and data models.

• Build and uphold semantic models for efficient reporting and self-service analytics.

• Collaborate with analytics and business teams to provide reliable datasets and dashboards.

• Ensure the quality, reliability, and usability of data across the analytics platform.

• Write, optimize, and fine-tune SQL and Spark-based transformations for large-scale analytical workloads.

• Implement version control, CI/CD principles, and code review standards in data engineering workflows.

• Ensure solutions satisfy performance, scalability, and maintainability requirements.

• Collect requirements from client stakeholders, convey technical concepts, and manage expectations effectively.

• Work alongside project managers, architects, and consultants to align project delivery with goals.

• Contribute to internal documentation, reusable patterns, and knowledge sharing initiatives.

• Act as a technical advisor for client data platform decisions.

• Provide scalable, well-documented solutions that adhere to best practices.

• Empower business users with dependable data models and analytics-ready datasets.

• Play a role in enhancing Collectiv’s data platform standards and consulting excellence.

⛳️ Requirements

• Bachelor's degree from an accredited university.

• Over 4 years of experience in data engineering, analytics engineering, or data platform consulting.

• Practical experience with Microsoft Fabric and/or Databricks in production settings; experience with both is strongly preferred.

• Proficient SQL skills, including performance tuning and optimization.

• Experience in designing data models for analytics, encompassing star schemas, semantic models, and lakehouse patterns.

• Familiarity with cloud data platforms; Azure is preferred.

• Ability to work autonomously in a client-facing consulting capacity.

• Experience in migrating or modernizing data platforms is preferred.

• Knowledge of Power BI dataset modeling and performance optimization is preferred.

• Experience with integrating data platforms with downstream applications or APIs is preferred.

• Consulting experience with various clients or industries is preferred.

• Strong written and verbal communication skills.

• Relevant certifications in Azure, Fabric, and Databricks are highly desirable.

🏝️ Benefits

• Fully remote work environment.

• Quarterly in-person team experiences.

• Competitive compensation.

• Professional development opportunities.

• Comprehensive benefits package.

• Unlimited time off.

• 100% covered health insurance for employee and family, including medical, dental, and vision plans.

• Competitive 401(k) with a 4% match.

• Educational assistance.

• Tech stipend.

• Discounts on various goods and services.

• Clear growth trajectory.

• Remote flexibility.