
Data QA Engineer – Microsoft Fabric
Posted 3 days ago

Posted 3 days ago
This is a fully remote position, open to applicants in Philippines.
• Design test strategies, plans, cases, and scripts based on both business and technical requirements.
• Ensure that testing processes encompass essential requirements, business rules, and risks associated with implementation.
• Utilize SQL and PySpark to verify source-to-target mappings, data transformations, data types, aggregations, business rules, duplicates, null values, and reconciliation results.
• Test data pipelines and integration workflows to confirm data is accurately extracted, transformed, and loaded into the designated environment.
• Execute functional, integration, and regression testing across Microsoft Fabric pipelines, notebooks, lakehouses, warehouses, SQL analytics endpoints, and semantic models.
• Validate data completeness, accuracy, consistency, referential integrity, and incremental-load behavior across both source and target systems.
• Assess pipeline performance, processing durations, scalability, error management, logging, monitoring, and recovery procedures.
• Identify, document, and monitor defects using Azure DevOps or other approved QA tools.
• Collaborate with developers to replicate issues, validate solutions, and conduct retesting.
• Create reusable SQL scripts, PySpark notebooks, reconciliation utilities, and automated regression tests.
• Maintain test plans, cases, traceability matrices, testing evidence, defect reports, and testing summaries.
• Partner with QA, data engineering, development, data analytics, and project management teams to clarify requirements, communicate testing progress, and tackle data quality challenges.
• A minimum of 4 years of experience in software quality assurance, specifically in data warehousing, ETL/ELT, data integration, or analytics testing.
• At least 1 year of direct experience testing or validating Microsoft Fabric solutions.
• Proficient SQL skills, including complex joins, common table expressions (CTEs), aggregations, reconciliation queries, and troubleshooting queries.
• Practical experience with Python or PySpark for data validation, transformations, dataset comparisons, and automated testing.
• Proven experience in developing and executing test strategies, plans, cases, scripts, and reports.
• Solid understanding of ETL/ELT processes, data warehousing principles, data lake/lakehouse architecture, and dimensional modeling.
• Experience in validating source-to-target mappings, data transformations, and business rules.
• Familiarity with Microsoft Fabric components, including Data Factory pipelines, notebooks, lakehouses, warehouses, and SQL analytics endpoints.
• Experience in identifying, documenting, tracking, and retesting defects using Azure DevOps or similar tools.
• Strong analytical and problem-solving abilities, with a talent for investigating data discrepancies and clearly communicating findings.
• Experience testing Delta Lake tables and medallion architecture (Bronze, Silver, and Gold layers).
• Familiarity with Azure services such as Azure Data Lake Storage, Azure SQL Database, Azure Synapse Analytics, Azure Key Vault, or Azure DevOps.
• Experience with various data sources and formats, including Oracle, SQL Server, APIs, CSV, XML, JSON, and Parquet.
• Experience in creating automated SQL/PySpark validation or reconciliation frameworks.
• Knowledge of performance testing, data pipeline monitoring, and validating production readiness.
• Fully remote work arrangement.
• Flexibility to work from anywhere within the Philippines.
• Opportunity to engage in a Microsoft Fabric implementation project.
• Hands-on experience with cutting-edge data engineering and cloud data technologies.
• Collaboration with skilled QA, data engineering, and development teams.
• Chance to contribute to enhancing enterprise data quality, reliability, and automation.
Republic Services
Intuitive
GE Aerospace
Syner-G BioPharma Group
Get handpicked remote jobs straight to your inbox weekly.