Real-Time Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, implement, and manage extensive Apache Kafka and Confluent Platform environments.

• Take full ownership of the Kafka platform, encompassing aspects such as cluster sizing, configuration, security, automation, observability, and enabling developers.

• Provide support for critical event-driven workloads.

• Collaborate with application teams to create a dependable, efficient, and developer-friendly streaming platform.

• Engage with product, design, engineering, operations, and business stakeholders.

• Convert vague requirements into well-structured engineering solutions.

• Contribute through code and design reviews, while mentoring junior engineers.

• Deliver significant production-ready outputs.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related technical field.

• Over 6 years of relevant experience.

• At least five years of experience managing Apache Kafka or Confluent Platform in a production environment.

• In-depth, practical understanding of Kafka internals, covering partitions, replication, ISRs, and consumer groups.

• Strong expertise in Kafka security, including SASL, mTLS, ACLs, and RBAC.

• Practical experience with Kafka Connect, Schema Registry, and either Kafka Streams or ksqlDB.

• Familiarity with high availability/disaster recovery strategies for Kafka.

• Proficient scripting skills in Python, Bash, or Go.

• Hands-on experience with infrastructure-as-code tools, such as Terraform and Ansible.

• Understanding of observability tools for Kafka.

• Exceptional troubleshooting, communication, and documentation abilities.

• Confluent Certified Administrator or Developer certifications are preferred.

• Experience running Kafka on Kubernetes, particularly with Strimzi or Confluent Operator, is preferred.

• Knowledge of managed Kafka services like AWS MSK or Azure Event Hubs Kafka API is preferred.

• Familiarity with Flink or Spark Streaming is preferred.

• Experience in data governance and lineage for streaming data is preferred.

• U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply.

• New H-1B visa petitions cannot be supported for this position.

🏝️ Benefits

• Comprehensive benefits package.

• Competitive salary and compensation structure.

• Emphasis on a supportive work-life balance.

• Opportunities for career advancement.

• Continuous learning and development prospects.