Data Engineer – Global

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop and sustain beehiiv’s ClickHouse data models and aggregations for both application and internal analytics purposes.

• Collaborate with Product Engineering to design and roll out event-streaming applications.

• Strengthen the Kafka streaming ecosystem focusing on security, performance, cost efficiency, and scalability.

• Automate the deployment of related schemas, which includes Kafka topics, Avro schemas, applications, and database migrations.

• Establish a data lake system for long-term data storage, disaster recovery, and cost optimization.

• Create streaming applications for upstream ETL processes, such as IP information enrichment.

• Develop beehiiv’s global entity-resolution system.

• Construct a first-party data-enrichment product utilizing the entity-resolution system.

• Set up testing environments for systems that depend on third-party applications.

• Maintain a schemaless architecture that accommodates and exposes arbitrary customer event JSON through a high-performance query layer.

⛳️ Requirements

• A minimum of 4 years of experience as a Data Engineer or a highly technical Data Analytics Engineer.

• Exceptional SQL proficiency.

• Proven experience in building and maintaining data models for analytics and machine learning feature stores.

• Background in managing complex database migrations.

• Familiarity with ClickHouse or other similar OLAP databases.

• Knowledge of real-time streaming and event-driven architectures based on Kafka, including Kafka Connect, Schema Registry, and Avro.

• Experience with Kafka streaming tools and applications like Goka.

• Proficient coding skills in one or more languages such as Go, Python, or Ruby.

• Experience with production deployments of RESTful APIs.

• Hands-on experience with Kubernetes, including Deployments, StatefulSets, Helm, and troubleshooting.

• Proficiency with AWS services, including S3, EKS, VPCs, IAM, and EFS.

• Experience managing and deploying infrastructure using Infrastructure as Code (IaC) tools like Terraform.

• Familiarity with CI/CD processes for application deployment and coordinating schema changes across systems.

• Completion of the Values Assessment Questionnaire is required.

• Comfortable collaborating with engineers across Data and broader Product teams.

• Able to navigate through disagreement and commitment, ambiguity, rapid iteration, context switching, and managing multiple priorities.

• Experience in the creator economy or SaaS sector.

• Bonus: Exposure to Apache Iceberg, schema catalogs, entity resolution systems, ad attribution systems, graph databases, AI/data security layers, or SQL-like DSL development.

🏝️ Benefits

• Competitive salary.

• Stock options.

• Health, dental, and vision insurance.

• 401(k) employer match.

• Unlimited PTO with a mandatory minimum of 10 days per year.

• Annual in-person team offsite.

• Unlimited budget for books.

• Monthly Wellness Days (every third Friday of the month).