This is a fully remote position, open to applicants in Thailand.

• Administer and oversee website scraping configurations utilizing Python.

• Track scraping configurations for errors and possible failures.

• Supervise collected data to identify potential issues and obstructions.

• Collaborate with stakeholders to grasp scraping task requirements and address issues.

• Prepare and distribute regular reports on scraping activities to stakeholders.

• Create essential pipelines to ingest data into the Datalake and execute necessary transformations.

• Demonstrated experience in data engineering with a focus on designing and executing scalable data architectures.

• Extensive experience with ETL processes, data modeling, and data warehousing (preferably Airflow & DBT).

• Proficiency in database technologies, including both relational (SQL) and NoSQL.

• Familiarity with cloud platforms, especially Azure.

• Strong grasp of data security protocols and compliance standards.

• Excellent proficiency in Python for data engineering and automation tasks.

• Strong collaborative abilities to work effectively with data scientists and analysts.

• Capacity to optimize data pipelines for enhanced performance and efficiency.

• Ability to build, test, and sustain tasks and projects.

• Experience with version control systems, such as Git.

• Practical experience with Airflow and/or DBT.

• Experience using Terraform for infrastructure management.

• At least 2 years of experience in a comparable role.

• Strong educational background in a relevant discipline.

• Fluent in English (French is an advantage).

• Competitive salary and performance-based incentives.

• Opportunities for professional development and career growth.

• Flexible working hours and remote work options.

• Comprehensive health and wellness benefits.

Data Engineer – Web Scraping, Contract

People also viewed