Senior Data Engineer

This is a fully remote position, open to applicants in Egypt.

📋 Description

• Data platform engineering: Design and sustain scalable batch and near-real-time data pipelines across mobile applications, NFC/fuel transactions, station integrations, ERP integrations, payments, support systems, and operational databases.

• Data modeling: Develop clean, reusable data models for essential entities such as customers, vehicles, drivers, stations, transactions, wallets, limits, invoices, products, maintenance services, and geographic coverage.

• Reliability and quality: Implement data validation, lineage, observability, alerting, reconciliation, and automated quality checks to ensure that business-critical dashboards and reports are accurate and timely.

• Analytics enablement: Collaborate with analytics, product, finance, operations, and customer success teams to provide self-service datasets, metrics layers, and well-documented data marts.

• Performance and cost optimization: Optimize queries, storage layouts, orchestration schedules, and cloud resources to enhance platform performance and effectively manage infrastructure costs.

• Data governance and security: Enforce data access controls, PII handling, retention practices, auditability, and compliance-aware engineering patterns throughout the data lifecycle.

• Integration engineering: Create robust ingestion patterns for APIs, webhooks, CDC, files, event streams, third-party integrations, and partner station data feeds.

• DevOps for data: Implement CI/CD, version control, automated testing, infrastructure-as-code, and deployment standards for data pipelines and transformations.

• Incident management: Address data incidents, perform root-cause analysis, minimize recurring failures, and effectively communicate impacts to stakeholders.

• Technical mentorship: Evaluate designs and code, establish engineering standards, mentor junior team members, and elevate the quality standards for data engineering at PetroApp.

⛳️ Requirements

• 5+ years of professional experience in data engineering, analytics engineering, platform engineering, or backend engineering with a strong emphasis on data ownership.

• Advanced SQL skills, including query optimization, data modeling, window functions, incremental transformations, and performance tuning for large tables.

• Strong Python programming experience for developing data pipelines, automation, testing, and production-grade data workflows.

• Hands-on experience with workflow orchestration tools such as Airflow, Dagster, Prefect, or similar platforms.

• Familiarity with modern data warehouses or lakehouse platforms like BigQuery, Snowflake, Redshift, Databricks, Delta Lake, Iceberg, or equivalents.

• Experience in building reliable ELT/ETL pipelines utilizing tools such as dbt, Spark, Kafka, Flink, Fivetran, Stitch, custom API ingestion, or CDC frameworks.

• Practical understanding of data quality, schema evolution, monitoring, alerting, backfills, idempotency, and failure recovery.

• Experience in designing dimensional, wide-table, and event-based data models for business intelligence, analytics, and operational reporting.

• Comfort in working with cloud platforms such as AWS, GCP, or Azure, as well as Git-based engineering workflows.

• Excellent communication skills with the ability to translate business requirements into clear technical designs and delivery plans.

• Experience in fintech, payments, fleet management, logistics, mobility, marketplace, fuel, or high-volume transaction platforms.

• Knowledge of event-driven architectures, streaming data, CDC, API integrations, data contracts, and data mesh or domain-oriented data ownership.

• Experience in supporting BI tools like Power BI, Looker, Tableau, Metabase, Superset, or similar platforms.

• Familiarity with MLOps or feature engineering for applications such as fraud detection, anomaly detection, forecasting, customer segmentation, or optimization use cases.

• Experience with data privacy, access control, encryption, secrets management, and compliance expectations in the Middle East or multi-country operations.

🏝️ Benefits

• Competitive salary and benefits package.

• Opportunity to work on cutting-edge technology with a passionate team.

• Career growth and development opportunities.

• A collaborative and inclusive work environment.