Azure Data Engineer, Databricks Certified

This is a fully remote position, open to applicants in India.

📋 Description

• Design, develop, and implement scalable and dependable data solutions on the Microsoft Azure platform.

• Collaborate with cross-functional teams to collect and analyze data requirements.

• Create and implement data ingestion pipelines to gather data from diverse sources, ensuring data integrity and reliability.

• Carry out data integration and transformation tasks, ensuring data quality and consistency.

• Implement data storage and retrieval methods, utilizing Azure services such as Azure SQL Database, Azure Data Lake, and Azure Blob Storage.

• Monitor data pipelines and resolve issues to guarantee smooth data flow and availability.

• Establish data quality measures and governance practices to ensure data accuracy, consistency, and privacy.

• Work alongside data scientists and analysts to meet their data needs and facilitate data-driven insights.

⛳️ Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field.

• Over 5 years of experience with Big Data technologies.

• Strong expertise and experience with the Microsoft Azure cloud platform.

• Proficient in SQL with experience in SQL-based database systems.

• Familiarity with batch processing and data streaming.

• Proficient in data processing frameworks such as Apache Spark, Apache Hadoop, or cloud-native data processing services (Azure Data Lake, Azure Data Factory, Azure Databricks, Azure Synapse, Snowflake, CosmosDB).

• Practical experience with Azure data services, including Azure SQL Database, Azure Data Lake, and Azure Blob Storage.

• Experience utilizing Azure Databricks in practical scenarios.

• Familiarity with data integration and ETL (Extract, Transform, Load) processes.

• Strong analytical and problem-solving abilities.

• Solid understanding of data engineering principles and best practices.

• Experience with programming languages such as Python or Scala.

• Relevant certifications in Azure data services or data engineering are advantageous.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Flexible working hours and remote work options.

• Opportunities for professional development and training.

• A collaborative and inclusive work environment.