Platform Engineer

This is a fully remote position, open to applicants in Switzerland.

📋 Description

• Provide support, maintenance, and optimization for Cloudera, Elastic Stack, and Dataiku platforms.

• Design and develop data pipelines, workflows, dashboards, and integrations for the platforms.

• Construct and maintain real-time streaming solutions utilizing Apache Kafka.

• Create custom scripts, plugins, and integrations using Python, Scala, and REST APIs.

• Design and automate ETL and data ingestion processes with tools like Apache NiFi and Logstash.

• Develop Kibana dashboards, reports, queries, and search solutions.

• Assist in the deployment and operationalization of machine learning models within Dataiku.

• Automate platform deployments and operations through Ansible, Terraform, or similar tools.

• Implement CI/CD pipelines using GitHub Actions, Jenkins, or equivalent technologies.

• Diagnose platform, workflow, and integration issues.

• Produce reusable scripts, templates, libraries, and technical documentation.

• Offer guidance, training, and platform support to users and internal teams.

• Participate in occasional weekend or public holiday activities concerning system changes or testing.

⛳️ Requirements

• Extensive experience with at least two of the following platforms:

• - Cloudera

• - Elastic Stack

• - Dataiku DSS

• - Solid understanding of Hadoop ecosystem technologies, including HDFS, YARN, Hive, Spark, and Kafka.

• - Proficiency with Elasticsearch, Logstash, Kibana, and Beats.

• - Background in designing data pipelines, ETL processes, and streaming solutions.

• - Programming or scripting experience with Python and/or Scala.

• - Experience in integrating platforms and external systems via REST APIs.

• - Familiarity with GitHub, branching strategies, pull requests, and code reviews.

• - Experience in CI/CD, infrastructure automation, and deployment processes.

• - Understanding of clean code practices, secure coding, and documentation standards.

• - Strong troubleshooting, analytical, and communication abilities.

• - Capability to translate business requirements into practical technical solutions.

• - Proficient English language skills.

• ****Preferred Qualifications**

• - Experience with machine learning deployment and data science platforms.

• - Knowledge of Apache NiFi, Terraform, Ansible, or Puppet.

• - Experience in enterprise-scale data and analytics environments.

• - Familiarity with agile and DevOps working methodologies.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Opportunities for professional development and continuous learning.

• Flexible working hours and remote work options.

• Supportive and inclusive work environment.