Senior Data Engineer/Data Ops

This is a fully remote position, open to applicants in India.

📋 Description

• Design and implement cutting-edge solutions for managing petabytes of data encompassing billions of rows and joins.

• Develop and sustain our data pipelines that power our on-premise/cloud data warehouse utilized for generating and delivering our models.

• Oversee and enhance our fleet of data servers (the software), ensuring their reliability and capability to process billions of logs and data points.

• Create and operationalize data pipelines for our machine learning models in both bare-metal and cloud environments.

• Propose and lead initiatives aimed at enhancing our data processing capabilities.

• Contribute actively to the team, fostering continuous improvement.

⛳️ Requirements

• At least 5 years of professional experience in developing and maintaining large-scale data pipelines.

• Ability to identify opportunities for process improvements related to data.

• Experience in maintaining Kubernetes, Hadoop, and Spark infrastructure.

• Bachelor’s or Master’s degree in a quantitative discipline such as Mathematics, Physics, Computer Science, Machine Learning Engineering, Business Analytics, Information Management, or a related field.

• Proficiency in relevant programming languages (Python, Java, etc.).

• Expertise in SQL & NoSQL as well as big data processing pipelines (we utilize Python, Spark, Airflow).

• Demonstrated experience in managing data infrastructure capable of storing and processing petabytes of data (we employ Hadoop and Spark).

• Kubernetes specialist.

• Strong affinity for data.

• Excellent analytical and problem-solving abilities.

• Capability to convert business requirements into data-driven solutions.

• Outstanding stakeholder management skills.

• Previous experience with Clickhouse is advantageous.

• Background in ad-tech is a plus.

• Familiarity with real-time big data processing is beneficial.

• General understanding of machine learning techniques (such as Neural Networks, Random Forest, etc.) and ML frameworks (like Mlflow, PyTorch, TensorFlow, etc.) is a plus.

🏝️ Benefits

• Exceptional career advancement and learning opportunities.

• A unique chance to join a skilled team of industry experts and entrepreneurs driving significant change in the Adtech market.

• Direct, hands-on work experience with management.

• A dynamic, motivated, and diverse team located across Germany, India, Argentina, Ukraine, Turkey, the UK, and soon more countries.

• Flexible work-from-home options.

• A $500 budget for home-office setup.

• A $1,000 annual budget for learning and development.