Senior Test Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Create, develop, and implement test plans, test scenarios, and test cases for enterprise data platforms, ETL/ELT pipelines, and data integration solutions.

• Conduct comprehensive end-to-end ETL testing and verify data accuracy, completeness, transformation logic, reconciliation, and data quality across both source and target systems.

• Design and execute complex SQL queries for backend testing and data validation.

• Test extensive data processing solutions utilizing Databricks, Apache Spark, PySpark, Python, Hive, Hadoop/HDFS, and Azure Data Factory.

• Execute functional, integration, regression, system, and data quality testing across various data pipelines and applications.

• Validate batch processing, job scheduling, dependencies, and workflow execution using Control-M and Unix/Linux environments.

• Identify, document, track, and retest defects while effectively collaborating with developers, data engineers, business analysts, and other stakeholders until resolution.

• Develop and sustain reusable test scripts and automation solutions where applicable.

• Engage in Agile/Scrum activities including sprint planning, refinement, daily stand-ups, reviews, and retrospectives.

⛳️ Requirements

• Over 8 years of experience in software quality engineering/testing.

• Extensive experience in ETL testing, data validation, integration testing, and regression testing.

• Strong hands-on SQL capabilities, including complex queries for source-to-target validation, reconciliation, and data quality testing.

• Experience in testing large-scale data platforms and ETL/ELT pipelines.

• Proficient in Databricks, Apache Spark, PySpark, Python, and Azure Data Factory (ADF).

• Familiarity with Hadoop ecosystem technologies such as Hadoop/HDFS and Hive.

• Experience working in Unix/Linux environments and with enterprise job scheduling tools like Control-M.

• Solid understanding of data quality principles, data transformations, data mappings, and source-to-target validation.

• Knowledge of defect management and test management processes within Agile/Scrum delivery environments.

• Excellent analytical, troubleshooting, communication, and collaboration abilities.

• Capability to successfully pass a background investigation for U.S. employment.

🏝️ Benefits

• Competitive compensation package that includes a profit participation program.

• Comprehensive medical, dental, and vision benefits.

• Basic life insurance and accidental death & dismemberment insurance.

• Matching contributions available through a 401(k) plan.

• CGI share purchase plan.

• Paid accrued vacation leave, ranging from 10 to 20 days annually.

• Ten paid holidays each year.

• At least 80 consecutive hours of paid sick/safe leave.

• Paid parental leave, varying from 20 to 70 consecutive business days.

• Bereavement leave, ranging from 1 to 7 days per year.

• Paid jury duty leave, up to the time summoned.

• Opportunities for learning and tuition assistance.

• Wellness and well-being programs.

• Flexibility for remote work.

• Hybrid work model offering flexibility.

• Access to employee resource groups and community initiatives.