Associate Data Engineer

This is a fully remote position, open to applicants in Philippines.

📋 Description

• Create, develop, and sustain data pipelines and data warehouses for analytics infrastructure.

• Set up solutions utilizing approved patterns to transfer data from operational and external environments into the business intelligence framework.

• Oversee data integration and ETL processes, encompassing consolidation, aggregation, filtering, validation, data quality routines, and the creation of dimensions.

• Configure and implement automated tasks using established reusable patterns.

• Run production-level jobs while taking into account data dependencies, schedules, validation processes, and updates to data streams.

• Design, develop, validate, and continuously refine data models in alignment with business requirements.

• Collaborate with technical users to determine data needs and establish business guidelines.

• Partner with business stakeholders to enhance the BI platform and deliver accurate insights through new datasets.

• Conduct unit and system integration testing.

• Perform peer reviews, assist with testing, and keep documentation current.

• Supervise error-handling and logging tools and processes.

• Diagnose configuration and data issues.

• Monitor performance and escalate relevant concerns.

• Recognize opportunities to enhance the ETL environment.

• Implement monitoring, quality, and validation processes to guarantee data accuracy and integrity.

⛳️ Requirements

• Minimum of 2 years of experience in Data Engineering.

• Proficient in Python, Apache Kafka, AWS Redshift, AWS Glue, AWS S3, and Pentaho Data Integration.

• Strong understanding of data warehousing principles, traditional and MPP database designs, including star and snowflake schemas.

• At least 2 years of experience in data modeling.

• A minimum of 2 years of hands-on development experience with ETL tools like Pentaho, SSIS, Informatica, Talend, Fivetran, or Airflow.

• Familiarity with the architecture, design, and implementation of MPP databases such as Teradata, Snowflake, or Redshift.

• 3 years of experience in developing cloud-based analytics solutions, preferably with AWS or GCP.

• Knowledge of designing and executing streaming pipelines using Apache Kafka, Apache Spark, or Segment.

• Well-versed in database optimization and ETL tuning.

• Experience using Python in a cloud environment is preferred.

• Familiarity with NoSQL databases is preferred.

• Knowledge, experience, and exposure to AI tools are preferred but not mandatory.

• Ability to collaborate effectively across internal functional areas in uncertain circumstances.

• Strong analytical thinking and communication skills.

• Bachelor’s/College Degree in Computer Science/Information Technology, Engineering (Computer/Telecommunication), or 4-8 years of relevant experience in lieu of a degree.

• Capability to work remotely from any TaskUs Philippines site.

• Willingness to work from 8:00 PM to 5:00 AM PHT, based on business requirements.

🏝️ Benefits

• Competitive industry salaries.

• Comprehensive benefits packages.

• Support for employee well-being.

• An inclusive workplace environment.

• Opportunities for internal mobility.

• Professional growth and development prospects.

• Reasonable accommodations provided during the hiring process.