Big Data Platform Engineer

This is a fully remote position, open to applicants in India.

📋 Description

• Oversee and provide support for the Big Data platform infrastructure based on AKS.

• Manage Apache NiFi, Azure Event Hub, and Azure Functions.

• Develop and sustain CI/CD pipelines utilizing Azure DevOps.

• Track platform performance with Azure Monitor and Log Analytics.

• Diagnose and resolve platform, networking, and infrastructure challenges.

• Facilitate infrastructure automation using Terraform and Bicep.

• Ensure the security, governance, and compliance of the platform.

• Work collaboratively with Data Engineering teams to enable the platform.

• Execute upgrades, patching, capacity planning, and optimization tasks.

• Assist with production incidents and initiatives aimed at platform reliability.

⛳️ Requirements

• Minimum of 8 years of overall IT experience.

• At least 5 years of experience in Cloud Infrastructure Engineering.

• Over 4 years of experience in working with Kubernetes platforms.

• A minimum of 3 years of experience supporting enterprise-scale Data Platforms.

• At least 3 years of experience in DevOps/SRE methodologies.

• More than 2 years of experience with Azure Data Services.

• Strong practical knowledge of Apache NiFi.

• Significant hands-on experience with Azure Event Hub.

• Extensive hands-on experience with Azure Functions.

• Proven experience in administration of Enterprise-scale Data Platforms.

• Deep expertise in Azure Kubernetes Service (AKS).

• Proficient in Kubernetes and Azure Networking.

• Strong skills in Docker and Containerization.

• Well-versed in Azure DevOps and CI/CD practices.

• Comprehensive knowledge in Monitoring and Observability.

• Must have skills in Infrastructure as Code.

• Good-to-have skills in Platform Engineering, Observability, Security, and Data Platforms.

🏝️ Benefits

• Competitive salary and performance-based incentives.

• Flexible working hours and remote work options.

• Comprehensive health and wellness programs.

• Opportunities for professional development and career advancement.

• Collaborative and inclusive work environment.