Senior QA Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop the next generation of data quality and testing solutions at Gradient AI

• Ensure the reliability and integrity of customer data that drives Gradient AI products

• Create and sustain an automated data quality suite that operates on Airflow data refreshes

• Implement checks as code utilizing dbt tests, Soda, and custom SQL through version control and CI

• Verify data loads for completeness, sequence, and schema adherence prior to processing

• Stop or isolate failed data loads

• Reconcile data across Databricks layers and downstream outputs based on tolerance thresholds

• Identify anomalies, edge cases, and unforeseen changes in historical data between loads

• Establish severity levels and customer-specific overrides

• Generate customer-specific data quality reports that control downstream promotions

• Monitor quality metrics, phase out unreliable checks, and address coverage gaps

• Collaborate with engineers to integrate checks into new pipelines

• Provide timely feedback on quality issues and risks to engineers, stakeholders, and project managers

⛳️ Requirements

• Over 5 years of professional experience in quality assurance with an emphasis on backend automated testing

• Practical experience in developing automated data tests using Soda, dbt, or comparable frameworks

• Proficient SQL skills; experience with Spark SQL is advantageous

• Familiarity with Python programming

• Experience using Airflow or similar orchestration tools

• Experience with Databricks or a similar lakehouse environment, including Delta Lake

• Knowledge of version control and CI/CD processes

• Strong understanding of functional, integration, and regression testing relevant to data pipelines

• Excellent analytical, debugging, and root-cause analysis capabilities

• Strong verbal and written communication skills, including the ability to produce clear defect reports and quality summaries for both technical and non-technical audiences

• Capacity to work independently and mentor others on testing best practices

• Bonus: Experience with health insurance or healthcare data, anomaly detection or data observability tools, or front-end test automation tools such as Cypress or Playwright

🏝️ Benefits

• Generous stock options

• Unlimited vacation days

• Flexible schedule that accommodates remote work

• Comprehensive benefits package including medical, dental, vision, 401k, and more

• Numerous opportunities for learning and assuming new responsibilities

• Annual performance bonus

• Equity grant

• Merit-based salary increases, promotions, and company-wide compensation adjustments

• Enjoyable, team-oriented startup culture