Senior Engineer - Kafka

This is a fully remote position, open to applicants in United Kingdom.

📋 Description

• Oversee the design and execution of our Kafka ecosystem, which includes configuration, deployment, and optimization for reliability, performance, and scalability.

• Work closely with stakeholders to collect requirements and define Kafka use cases and architectures that are aligned with business goals.

• Create and implement Kafka integrations with other data systems and pipelines.

• Establish security protocols to safeguard Kafka clusters and data, incorporating encryption, authentication, and authorization.

• Set up monitoring, alerting, and logging systems to ensure the health and performance of Kafka clusters, while addressing issues as they emerge.

• Offer guidance and best practices to development teams regarding Kafka utilization, including producers, consumers, and stream processing applications.

• Collaborate with development teams to determine Kafka topics, partitions, and configurations based on application needs.

• Automate deployment, configuration, and monitoring tasks using tools like Terraform, Ansible, Puppet, or Chef.

• Keep abreast of the latest Kafka advancements and best practices, providing recommendations for ongoing enhancements.

⛳️ Requirements

• Bachelor’s degree in Computer Science, a related field, or equivalent professional experience.

• Demonstrable experience as a Kafka Engineer or in a similar capacity, with practical experience in deploying and managing Kafka clusters in production Cloud environments.

• Comprehensive understanding of Kafka architecture, encompassing brokers, topics, partitions, replication, and consumer groups.

• Significant experience in Kafka administration, monitoring, and troubleshooting.

• Familiarity with Kafka security features, including SSL/TLS encryption, Kerberos authentication, and ACLs.

• Knowledge of Kafka integration patterns and technologies such as Kafka Connect and other tools within the Kafka ecosystem.

• Proficient in programming and scripting languages, including Java, Scala, Python, or Shell scripting.

• Strong problem-solving capabilities and attention to detail.

• Excellent communication and collaboration skills, with a proven ability to work effectively with cross-functional teams.

🏝️ Benefits

• Competitive salary and benefits package.

• Flexible vacation policy.

• Adaptable work-from-home or office hours.

• Startup atmosphere supported by a stable, global brand.

• Chance to develop products that are enjoyed by millions, as part of a dedicated team.