Data QA Engineer – Microsoft Fabric

Posted 3 days ago

This is a fully remote position, open to applicants in Philippines.

📋 Description

• Design test strategies, plans, cases, and scripts based on both business and technical requirements.

• Ensure that testing processes encompass essential requirements, business rules, and risks associated with implementation.

• Utilize SQL and PySpark to verify source-to-target mappings, data transformations, data types, aggregations, business rules, duplicates, null values, and reconciliation results.

• Test data pipelines and integration workflows to confirm data is accurately extracted, transformed, and loaded into the designated environment.

• Execute functional, integration, and regression testing across Microsoft Fabric pipelines, notebooks, lakehouses, warehouses, SQL analytics endpoints, and semantic models.

• Validate data completeness, accuracy, consistency, referential integrity, and incremental-load behavior across both source and target systems.

• Assess pipeline performance, processing durations, scalability, error management, logging, monitoring, and recovery procedures.

• Identify, document, and monitor defects using Azure DevOps or other approved QA tools.

• Collaborate with developers to replicate issues, validate solutions, and conduct retesting.

• Create reusable SQL scripts, PySpark notebooks, reconciliation utilities, and automated regression tests.

• Maintain test plans, cases, traceability matrices, testing evidence, defect reports, and testing summaries.

• Partner with QA, data engineering, development, data analytics, and project management teams to clarify requirements, communicate testing progress, and tackle data quality challenges.


⛳️ Requirements

• A minimum of 4 years of experience in software quality assurance, specifically in data warehousing, ETL/ELT, data integration, or analytics testing.

• At least 1 year of direct experience testing or validating Microsoft Fabric solutions.

• Proficient SQL skills, including complex joins, common table expressions (CTEs), aggregations, reconciliation queries, and troubleshooting queries.

• Practical experience with Python or PySpark for data validation, transformations, dataset comparisons, and automated testing.

• Proven experience in developing and executing test strategies, plans, cases, scripts, and reports.

• Solid understanding of ETL/ELT processes, data warehousing principles, data lake/lakehouse architecture, and dimensional modeling.

• Experience in validating source-to-target mappings, data transformations, and business rules.

• Familiarity with Microsoft Fabric components, including Data Factory pipelines, notebooks, lakehouses, warehouses, and SQL analytics endpoints.

• Experience in identifying, documenting, tracking, and retesting defects using Azure DevOps or similar tools.

• Strong analytical and problem-solving abilities, with a talent for investigating data discrepancies and clearly communicating findings.

• Experience testing Delta Lake tables and medallion architecture (Bronze, Silver, and Gold layers).

• Familiarity with Azure services such as Azure Data Lake Storage, Azure SQL Database, Azure Synapse Analytics, Azure Key Vault, or Azure DevOps.

• Experience with various data sources and formats, including Oracle, SQL Server, APIs, CSV, XML, JSON, and Parquet.

• Experience in creating automated SQL/PySpark validation or reconciliation frameworks.

• Knowledge of performance testing, data pipeline monitoring, and validating production readiness.


🏝️ Benefits

• Fully remote work arrangement.

• Flexibility to work from anywhere within the Philippines.

• Opportunity to engage in a Microsoft Fabric implementation project.

• Hands-on experience with cutting-edge data engineering and cloud data technologies.

• Collaboration with skilled QA, data engineering, and development teams.

• Chance to contribute to enhancing enterprise data quality, reliability, and automation.

People also viewed

Republic Services6 hours ago

Senior Quality Assurance Engineer

US flagUnited States OnlyFull-timeQA Engineer (Quality Assurance)
ApplyView job
Intuitive6 hours ago

Staff Supplier Quality Engineer, ISO 13485 Lead Auditor

GE flagGeorgia OnlyFull-timeQA Engineer (Quality Assurance)$155.5k – $263.1k/year
ApplyView job
GE Aerospace6 hours ago

Lead Sourcing Specialist 2 – Supplier Quality Engineering

US flagMassachusetts OnlyFull-timeQA Engineer (Quality Assurance)$86k – $114k/year
ApplyView job
Syner-G BioPharma Group6 hours ago

Quality Engineer

US flagUnited States OnlyFull-timeQA Engineer (Quality Assurance)$120k – $150k/year
ApplyView job
Unqork6 hours ago

Senior QA Engineer – Runtime

US flagUnited States OnlyFull-timeQA Engineer (Quality Assurance)$100k – $137k/year
ApplyView job
HEAVY CONSTRUCTION SYSTEMS SPECIALISTS INC7 hours ago

QA Analyst I

US flagUnited States OnlyFull-timeQA Engineer (Quality Assurance)
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers