Senior Engineer - Kafka

This is a fully remote position, open to applicants in United Kingdom.

📋 Description

• Oversee the design and execution of our Kafka ecosystem, including its configuration, deployment, and optimization for reliability, performance, and scalability.

• Work closely with stakeholders to collect requirements and establish Kafka use cases and architectures that are in line with business goals.

• Create and implement Kafka integration with various data systems and pipelines.

• Enforce security protocols to safeguard Kafka clusters and data, encompassing encryption, authentication, and authorization.

• Set up monitoring, alerting, and logging systems to guarantee the health and performance of Kafka clusters, while addressing issues as they occur.

• Offer guidance and best practices to development teams regarding Kafka usage, including producers, consumers, and stream processing applications.

• Partner with development teams to determine Kafka topics, partitions, and configurations based on application needs.

• Automate deployment, configuration, and monitoring processes using tools such as Terraform, Ansible, Puppet, or Chef.

• Keep abreast of the latest advancements in Kafka and best practices, making suggestions for ongoing improvement.

⛳️ Requirements

• Bachelor's degree in Computer Science, a related discipline, or equivalent professional experience.

• Demonstrated experience as a Kafka Engineer or in a similar position, with practical experience in deploying and managing Kafka clusters in production Cloud environments.

• Profound knowledge of Kafka architecture, including brokers, topics, partitions, replication, and consumer groups.

• Extensive experience in Kafka administration, monitoring, and troubleshooting.

• Familiarity with Kafka security features, including SSL/TLS encryption, Kerberos authentication, and ACLs.

• Experience with Kafka integration patterns and technologies, such as Kafka Connect and other tools within the Kafka ecosystem.

• Proficiency in programming and scripting languages, including Java, Scala, Python, or Shell scripting.

• Exceptional problem-solving abilities and meticulous attention to detail.

• Strong verbal and written communication skills, with the ability to collaborate effectively with cross-functional teams.

🏝️ Benefits

• Competitive salary and benefits package.

• Flexible vacation policy.

• Option for flexible remote or in-office work hours.

• Startup culture supported by a secure, global brand.

• Chance to develop products enjoyed by millions as part of a dedicated team.