Principal Data Engineer

This is a fully remote position, open to applicants in South Africa.

📋 Description

• Oversee the design and implementation of scalable, secure, and resilient data systems that address streaming, batch, and real-time use cases.

• Design data pipelines, modeling, and storage solutions that support analytical and product applications, primarily utilizing Python and SQL through orchestration tools to execute workloads in the cloud.

• Utilize AI to enhance automation in both data processing and engineering workflows.

• Ensure and promote best practices regarding data infrastructure, governance, security, and observability.

• Collaborate with technologists from various teams to provide cohesive features and data results.

• Assist the data team in adopting data engineering methodologies.

• Identify, assess, and advocate for new tools and technologies that enhance the performance and stability of data services.

⛳️ Requirements

• Significant experience in delivering Python-based projects within the data engineering domain.

• Extensive experience with SQL and NoSQL database technologies.

• Proven track record with modern data warehousing and large-scale data processing tools.

• Hands-on experience with data orchestration tools.

• Familiarity with cloud platforms (e.g., Azure, AWS, GCP) for processing, storing, and presenting large-scale data.

• Experience with Kafka or similar event-driven architectures.

• Strong understanding of data architecture and data modeling principles applicable to both OLAP and OLTP workloads.

• Proficient in the broader software development lifecycle, particularly in agile methodologies and the continuous integration/deployment of data solutions.

• Experience serving as a lead or Principal Engineer on large-scale data initiatives or product developments.

• Demonstrated capability to architect data systems and structures for high-volume, high-throughput environments.

• Proven experience in leading data platform modernization or cloud migration projects.

• Comfortable with taking ownership of complex data challenges and guiding them to resolution.

🏝️ Benefits

• Parental leave

• Medical benefits

• Paid sick leave

• Dotdigital day

• Share reward

• Wellbeing reward

• Wellbeing Days

• Loyalty reward

• DEI commitment