Senior Data Engineer – Contractual Remote Opportunity

This is a fully remote position, open to applicants in India.

📋 Description

• Design, construct, and uphold data ingestion and transformation pipelines that populate Inchcape’s central data platforms.

• Ingest raw data from ERP, CRM, operational, financial, and third-party sources into Microsoft Fabric Lakehouse (OneLake) utilizing Delta Lake/Parquet.

• Establish data quality standards and controls, including incremental loading, CDC, and error management.

• Generate bronze, curated silver, and gold tables by transforming, cleansing, and conforming raw data.

• Document data lineage and transformations thoroughly.

• Enhance performance through partitioning, clustering, and tuning of Microsoft Fabric, SQL, and Spark workloads.

• Monitor the health of pipelines and associated costs.

• Collaborate with Data Architects, Modellers, and Data BAs regarding schemas, naming conventions, and integration patterns.

• Develop reusable components, templates, and automation scripts utilizing Fabric Dataflows Gen2, Spark notebooks, or similar tools.

• Maintain metadata and sensitivity labels via Purview while ensuring access controls and compliance.

• Investigate and assess Microsoft Fabric features and patterns, providing recommendations for adoption.

• Lower total operational costs through economical and optimized data integration techniques.

• Implement resilience, availability, and security standards in line with agreed NFR metrics.

• Deliver automated, well-documented ingestion pipelines equipped with monitoring and alerting capabilities.

• Produce high-quality conforming bronze, silver, and gold data assets for self-service use.

• Generate performance benchmarks and tuning reports.

• Contribute to ingestion templates, best-practice guides, and knowledge sharing initiatives.

• Create low-level designs for data pipelines and data integration assets.

⛳️ Requirements

• Over 8 years of experience in data engineering or data integration roles.

• Proficient in SQL, Python, and/or Scala.

• Familiarity with ETL/ELT patterns, CDC, incremental loading, and data warehousing principles using Microsoft Fabric.

• Hands-on experience with Delta Lake, Lakehouse/Medallion architecture, and cloud data platforms (Azure and AWS).

• Expertise in building pipelines with MS Fabric Dataflows Gen2, Spark/SQL notebooks, or similar tools.

• Experience with data quality frameworks and monitoring/observability tools.

• Strong ability to collaborate across teams and communicate technical concepts to non-engineers.

• Bachelor's degree in computer science, engineering, or a related field.

• Azure Data Engineering certification is required.

• Satisfactory references are mandatory.

• Valid Right to Work documentation is required based on geographical location.

🏝️ Benefits

• Contract opportunity lasting 3–4 months, with potential for extension based on business needs.

• Opportunities for training and professional development.

• A diverse and inclusive workforce.

• An equal opportunities employer.

• Chance to build a fulfilling career in a dynamic industry.