Software Engineer, Data Platform

This is a fully remote position, open to applicants in California.

📋 Description

• Construct and enhance our data lake.

• Create high-throughput data movement and ingestion services.

• Manage streaming and batch ingestion along with change-data-capture pipelines.

• Develop new query and analytics functionalities directly on the data lake.

• Maintain the low-latency serving layer for real-time, high-concurrency access to platform data.

• Collaborate with infrastructure and product teams to provision, secure, and scale the platform.

⛳️ Requirements

• A minimum of 3 years of experience in software engineering, focusing on data infrastructure or large-scale distributed systems.

• Strong proficiency in Python.

• Eagerness to learn and work with Go.

• Practical experience with big data or streaming technologies such as Spark, Kafka, or Flink.

• Proven track record in building and managing scalable data pipelines for both structured and unstructured data.

• Solid understanding of distributed systems, storage, and performance/cost optimization.

• Exceptional communication and collaboration skills with engineering, data science, and infrastructure teams.

• Preferred qualifications: Experience with ClickHouse, DuckDB, Google Cloud (GCP), Kubernetes, MySQL, MongoDB, Snowflake.

🏝️ Benefits

• Medical, dental, and vision insurance.

• 3% contribution to 401(k).

• Unlimited paid time off (PTO).

• Quarterly mental health days.

• Family planning benefits.

• Stipend for professional development.

• Wellness benefits.

• Private medical insurance for UK employees.

• Dental insurance for UK employees.

• 6% employer pension contribution for UK employees.

• Monthly wellness stipend for UK employees.

• Co-working stipend for UK employees.