Data Engineer

This is a fully remote position, open to applicants in Egypt.

📋 Description

• Design and develop extraction, transformation, and loading (ETL) pipelines utilizing Microsoft Fabric (Dataflow Gen2, Notebooks, or similar tools).

• Craft optimized SQL queries and transformations for data ingestion from specified source systems.

• Implement data quality rules and validation logic at every stage of the pipeline.

• Execute incremental loads and oversee refresh schedules to enhance performance.

• Consult with the Lead for architectural decisions or intricate transformation patterns.

• Establish and carry out data quality checks during ingestion, transformation, and output phases.

• Conduct ongoing data validation to ensure pipeline outputs meet business logic and source system expectations.

• Identify, document, and escalate data quality concerns with thorough root cause analysis.

• Maintain data quality dashboards and monitor service level agreements (SLAs).

• Assist in user acceptance testing (UAT) for new data sources or transformation logic.

• Develop and manage data transformations using Power Query, SQL, or Python as necessary.

• Create dimensional models and establish aggregation logic that aligns with analytics needs.

• Enhance data structures for optimal performance and maintainability.

• Document transformation logic, lineage, and assumptions according to team standards.

• Diagnose pipeline failures and performance challenges; coordinate solutions with IT/Engineering teams.

• Address data discrepancy reports from business users and analysts.

• Keep documentation of data sources, data dictionaries, and transformation specifications up to date.

• Assist with capacity planning and the optimization of Fabric environments and pipelines.

• Collaborate with the Lead to define semantic models and calculated metrics.

⛳️ Requirements

• Advanced SQL skills — including query optimization, window functions, performance tuning, and debugging complex transformations.

• Proficient in Microsoft Fabric — (Dataflow Gen2, Notebooks, Lakehouse) or equivalent ETL tools (Python, dbt, Talend, Informatica).

• Strong grasp of relational database design and dimensional modeling principles.

• Expertise in Power Query / M — focusing on complex data shaping, merging, error handling, and transformation logic.

• Familiarity with Python or a similar scripting language for data manipulation and pipeline automation.

• Basic knowledge of Git/version control to collaborate on code and track changes.

• Understanding of data quality and testing frameworks — including unit tests, assertions, and validation rules.

• Ability to interpret business requirements and design efficient data solutions accordingly.

• Data governance mindset — comprehending data lineage, documentation, and quality standards.

• Proactive in identifying edge cases and potential data issues.

• Familiarity with the mortgage/lending domain is preferred; however, a willingness to learn the domain is required.

• Works effectively within established standards and escalates architectural inquiries to the Lead.

• Capable of balancing speed with quality and advocates for technical excellence.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Flexible work hours and the option for remote work.

• Opportunities for professional development and continuous learning.

• Collaborative and inclusive work environment.