Senior Data Engineer – India

This is a fully remote position, open to applicants in India.

📋 Description

• Design, architect, and execute comprehensive data solutions utilizing Azure Databricks, PySpark, Azure Data Factory, and Azure SQL.

• Create, develop, and sustain data pipelines from various sources through integration to end-user consumption.

• Establish data modeling standards across bronze, silver, and gold layers of the data lake.

• Create conceptual, logical, and physical data models.

• Enhance Spark and SQL workloads for optimal performance, scalability, and cost-effectiveness.

• Oversee metadata management using data preparation, integration, and AI-driven tools.

• Propel the automation of data integration and repetitive data preparation activities.

• Construct REST/JSON API integrations and frameworks for real-time data ingestion.

• Streamline workflows through Azure DevOps pipelines and Git-based CI/CD practices.

• Develop reusable pipeline templates for data ingestion and transformation.

• Create automated frameworks for unit, regression, and integration testing.

• Prepare and curate datasets for business intelligence, reporting, and advanced analytics.

• Collaborate with analytics teams to establish semantic models and key performance indicators (KPIs).

• Implement performance-optimized models for self-service analytics.

• Provide support to end users with data visualization solutions as necessary.

• Lead technical design reviews and mentor junior engineering staff.

• Collect and refine data requirements with cross-functional teams, business analysts, and stakeholders.

• Work alongside business and IT stakeholders to ensure alignment of data engineering with organizational goals.

• Contribute to the development of architectural roadmaps and technology assessments.

• Identify inefficiencies and provide recommendations for improvements to the executive team.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related discipline.

• 5–8 years of experience in designing and developing enterprise-level data solutions.

• Expert-level knowledge in Databricks, Azure Fabric, PySpark, SQL, and Azure DevOps.

• Demonstrated experience with Azure Data Factory, ADLS Gen2, and Azure SQL Server.

• Strong background in Microsoft Azure data management architectures, including Data Warehouse, Data Lake, and Data Catalogue.

• Experience with Power BI is required; familiarity with Tableau or Looker is a plus.

• Working knowledge of CI/CD automation, Git, and infrastructure as code (ARM, Bicep, or Terraform).

• Solid understanding of GxP, GDPR/HIPAA, and relevant CFR/CTR/CTD regulations.

• Proven ability to collaborate with IT and business stakeholders while integrating analytics and data science deliverables into business processes and workflows.

• Exceptional written and verbal communication skills.

• Capability to work autonomously as well as collaboratively within a team while adhering to critical deadlines.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Flexible working hours and remote work options.

• Professional development opportunities and ongoing training.

• Supportive and inclusive company culture.