Data Engineer – Microsoft Fabric, Azure

This is a fully remote position, open to applicants in United States.

📋 Description

• Create and implement comprehensive data ingestion and transformation pipelines using Azure technologies such as Azure Data Factory and Synapse Pipelines.

• Build and enhance Azure Databricks Spark data processing tasks utilizing PySpark or Scala.

• Oversee Databricks workspaces and clusters, optimizing configurations and troubleshooting jobs for both performance and cost-effectiveness.

• Provision and manage Azure data platform resources across different environments using Infrastructure-as-Code methodologies.

• Establish and maintain Azure DevOps CI/CD build and release pipelines for seamless automated deployments.

• Assist in the daily operations of the Azure Modern Data Platform.

• Monitor and ensure platform stability across storage and compute resources.

• Address connectivity and networking challenges.

• Guarantee that Azure RBAC permissions and data security protocols are properly implemented.

• Collaborate with data architects, BI developers, cloud engineers, and client stakeholders.

• Align solutions with Azure best practices, Quisitive standards, and business objectives.

⛳️ Requirements

• A minimum of 3 years of practical data engineering experience with Microsoft Azure, covering data ingestion, ETL/ELT pipeline development, and big data processing.

• Expertise in Azure Databricks, Azure Data Factory, Azure Synapse Analytics, and associated SQL/NoSQL technologies.

• Familiarity with Azure DevOps Repos and Pipelines for CI/CD, code management, deployment pipelines, and automated release processes.

• Hands-on experience with Infrastructure-as-Code using Bicep, ARM templates, or Terraform.

• Proficient programming skills in Python or Scala for Spark applications.

• Strong SQL capabilities for executing data transformations.

• Understanding of Microsoft Fabric and Azure fundamentals, including cloud networking, security, permissions, and monitoring.

• Exceptional problem-solving abilities and effective communication skills with technical teams and clients.

• Must be a US citizen or have authorization to work in the United States.

• Ability to work independently without employer sponsorship, as sponsorship is not available.

• Preference for candidates located in the Eastern or Central time zones.

🏝️ Benefits

• Competitive salary and performance-based incentives.

• Comprehensive health benefits including medical, dental, and vision coverage.

• Opportunities for professional development and career advancement.

• Flexible work hours and remote work options.