Senior ETL Testing, Data Engineer

This is a fully remote position, open to applicants in India.

📋 Description

• Design and implement scalable ETL and ELT processes using GCP services such as BigQuery, Cloud Dataflow, and Cloud Data Fusion.

• Manage and orchestrate data workflows with Cloud Composer (Apache Airflow) to ensure efficient data movement and processing.

• Develop and maintain data warehousing solutions across platforms like Snowflake, Oracle, Teradata, and various SQL databases.

• Write efficient and high-performance code in Java and Python to manage complex data transformations and logic.

• Construct advanced SQL queries that involve window functions, CTEs, and complex joins for data extraction and manipulation.

• Establish and enforce testing protocols, including source-to-target reconciliation, schema validation, and regression testing.

• Integrate data pipelines into CI/CD workflows utilizing Jenkins, Git, and GCP Cloud Build to enhance deployment and version control.

• Collaborate within an Agile environment using Jira and Confluence to monitor progress, manage defects, and document technical specifications.

• Utilize Informatica PowerCenter and Talend for enterprise-level data integration tasks.

⛳️ Requirements

• 5 to 10 years of professional experience in data engineering, ETL testing, or related fields.

• Proven expertise with Google Cloud Platform (GCP) services, particularly BigQuery, Cloud Storage, and Cloud Composer.

• Strong knowledge of relational and NoSQL databases, including PostgreSQL, MySQL, Cloud SQL, Cloud Spanner, Oracle, and Snowflake.

• Advanced skills in Java (JDBC, Apache Beam SDK) and Python (Pandas, PyTest).

• Expert-level proficiency in SQL, encompassing complex joins, window functions, and PL/SQL.

• Hands-on experience with testing frameworks such as TestNG, JUnit, and BDD Cucumber, along with data-driven testing methodologies.

• Familiarity with CI/CD pipelines, Git, GitHub, Maven, and defect tracking systems like Jira and HP ALM.

• Must be available for remote work.

🏝️ Benefits

• Competitive salary package.

• Flexible working hours and remote work options.

• Opportunities for professional development and continuous learning.

• Health and wellness benefits.

• Collaborative and inclusive company culture.