Senior Data Engineer

This is a fully remote position, open to applicants in Singapore.

📋 Description

• Design, maintain, and enhance robust ETL/ELT pipelines utilizing Talend to ingest and transform a variety of structured and semi-structured datasets.

• Create high-performance data processing pipelines and transformation tasks using Apache Spark.

• Collaborate with Lead Solution Architects to establish data governance, manage schemas, and automate data quality checks.

• Identify and resolve issues related to pipeline performance, memory leaks, and job failures in distributed big data environments.

• Write efficient SQL and assist in the integration of data into downstream query engines and lakehouse storage systems.

• Engage in daily standups, sprint planning, and conduct code reviews.

• Keep comprehensive technical documentation for all pipelines delivered.

⛳️ Requirements

• At least 5+ years of practical experience in data engineering focused on building enterprise data pipelines.

• Strong, proven expertise in pipeline development and deployment using Talend.

• Solid hands-on experience in developing and optimizing data processing jobs with Apache Spark (either PySpark or Scala).

• Advanced SQL skills, including performance optimization, indexing techniques, and query tuning for large-scale datasets.

• Practical experience with version control (Git), CI/CD pipelines, and Agile development methodologies.

• Proficient in conversational English, enabling effective technical collaboration, participation in standups, and documentation.

• Bachelor’s degree in Computer Science, Software Engineering, Information Technology, or equivalent practical experience.

🏝️ Benefits

• Remote position.

• Asynchronous, cross-functional remote environment.

• Daily Agile rhythm.

• Opportunity to participate in code reviews and engage in professional collaboration.