Data Platform Engineer

This is a fully remote position, open to applicants in South Africa.

📋 Description

• Create and deploy cloud-based data platform infrastructure utilizing Infrastructure as Code (Terraform).

• Develop and sustain CI/CD pipelines that automate data engineering processes.

• Execute and manage observability solutions that incorporate monitoring, logging, and metrics.

• Collaborate effectively with data engineers and cross-functional teams.

• Implement best practices for high availability, disaster recovery, security, and cost efficiency.

⛳️ Requirements

• 3-5 years of practical experience in Data Engineering, Platform Engineering, or DataOps positions.

• Demonstrated success in designing and executing reliable, scalable data platforms and infrastructures.

• Practical experience with contemporary data engineering tools such as dbt, Apache Airflow, or Apache Kafka.

• Proficient in Infrastructure as Code (Terraform) and cloud architecture patterns on AWS or GCP.

• Extensive experience with AWS or GCP, including data storage and processing services (e.g., BigQuery, Snowflake, S3, Redshift).

• Hands-on experience with Kubernetes and containerized workloads.

• Experience in implementing observability stacks for monitoring, logging, metrics, and alerting within data platforms.

• Strong programming capabilities in Python, SQL, and Bash.

• Excellent problem-solving abilities and the capacity to work effectively in a collaborative, fully remote setting.

• A strong desire to enhance expertise in data architecture, data modeling, and MLOps capabilities.

• Familiarity with real-time data processing (e.g., Kafka, Spark Streaming) and both SQL and NoSQL data storage solutions is advantageous.

🏝️ Benefits

• Flexible working hours

• Professional development opportunities