Data Engineer – Snowflake, DataStage

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop and manage data pipelines essential for the enterprise's data and analytics capabilities.

• Work collaboratively in an agile, cross-functional team to create effective data integration and transformation solutions.

• Document and evaluate both functional and non-functional data requirements to design scalable, automated, and fault-tolerant data pipeline solutions that support business and technology goals.

• Analyze data to determine the accuracy and completeness of sources, collaborating with business partners to resolve any issues.

• Construct and oversee data pipelines utilizing suitable tools and methodologies across development, testing, and production environments.

• Design with modularity in mind to promote code reuse wherever feasible.

• Develop data mappings, programs, routines, and SQL queries to extract data from legacy systems, web, cloud, and commercial package environments into the analytics ecosystem.

• Employ a combination of ELT, ETL, data virtualization, and other techniques to achieve an optimal balance between minimal data movement and performance efficiency.

• Manage metadata processes and maintain thorough documentation.

• Track data quality to identify emerging issues and collaborate with the team to formulate transformation rules for data cleansing according to established standards and guidelines.

• Engage in code reviews and unit testing to enhance performance and reduce potential issues.

⛳️ Requirements

• A bachelor’s degree in computer science, data science, statistics, economics, or a related field; or equivalent professional experience.

• Over 4 years of experience in a development team, providing analytical capabilities.

• More than 4 years of practical experience in the data domain, covering data preparation, SQL, integration tools, and ETL/ELT/data pipeline design.

• Proficiency in SQL coding.

• Experience with agile development methodologies (Scrum, Kanban), emphasizing Continuous Integration and Delivery.

• Prior use of a data integration platform such as IBM InfoSphere DataStage, Oracle Data Integrator, Informatica PowerCenter, MS SSIS, AWS Glue, or Denodo.

• Knowledge of data warehouse MPP platforms like Snowflake, Netezza, Teradata, Redshift, etc.

• Familiarity with event stores and stream processing technologies (e.g., Apache Kafka and platforms like Confluent).

• Understanding of API development and management platforms (such as MuleSoft, Axway) is advantageous.

• Ability to concentrate on specific tasks while aligning with broader strategic designs.

• Demonstrates characteristics of a proactive, self-motivated contributor who values ongoing learning and the adoption of new technologies.

🏝️ Benefits

• Eligible for bonuses and commissions.