This is a fully remote position, open to applicants in Morocco.

• Manage and maintain configurations for website scraping using Python.

• Monitor scraping configurations to identify errors and prevent potential crashes.

• Supervise the data retrieved to identify possible issues and blockages.

• Collaborate with stakeholders to understand the requirements of scraping tasks and report any issues.

• Prepare and distribute regular reports on scraping activities to stakeholders.

• Create necessary pipelines for data ingestion into the Datalake and conduct required transformations.

• At least 2 years of experience in a comparable role.

• Demonstrated experience in data engineering with a focus on designing and implementing scalable data architectures.

• Extensive experience with ETL processes, data modeling, and data warehousing (Airflow & DBT preferred).

• Proficiency in database technologies, including both relational (SQL) and NoSQL systems.

• Familiarity with cloud platforms, especially Azure.

• Strong knowledge of data security measures and compliance standards.

• Excellent Python skills for data engineering and automation tasks.

• Strong teamwork abilities to collaborate effectively with data scientists and analysts.

• Capability to optimize data pipelines for improved performance and efficiency.

• Ability to build, test, and maintain various tasks and projects.

• Experience with version control systems, such as Git.

• Practical experience with Airflow and/or DBT.

• Experience utilizing Terraform for infrastructure management.

• Strong academic credentials in a relevant discipline.

• Proficient in English (French is an advantage).

• Comprehensive health and wellness programs.

• Opportunities for professional development and growth.

• Flexible work arrangements.

• Collaborative and dynamic work environment.

Data Engineer

People also viewed