Lead Software Engineer – Real-Time Events

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, develop, and deploy features for the event pipeline in a production environment.

• Take responsibility for the architecture of the components of the pipeline you lead.

• Assess both current and emerging technologies that provide significant cost, latency, or operational benefits, and implement those technologies in production.

• Participate in architectural discussions and take charge of significant pipeline initiatives.

• Establish stable contracts with downstream consumers.

• Guide colleagues through design reviews, code reviews, and collaborative programming sessions.

• Assist teammates in delivering features using well-defined interfaces, robust testing, and production-ready patterns.

• Collaborate with Product, Data, and ZMP consumer teams to convert latency, throughput, and correctness SLAs into functional systems.

• Implement service instrumentation and enhance alerting mechanisms.

• Manage on-call responsibilities and drive post-incident remediation efforts, including root cause analysis, code updates, runbooks, and dashboards.

• Maintain the pipeline's stability under high load conditions.

⛳️ Requirements

• A minimum of 8–10 years of experience in software engineering, including Lead/Staff-level roles in event, streaming, or data infrastructure systems.

• Hands-on experience in production environments with event streaming (Kafka or similar), Python services and APIs (such as FastAPI), and pipeline processing (like Spark/EMR or equivalent) as necessary.

• Expertise in designing, deploying, and managing systems on AWS (including S3, SQS/SNS, Lambda, RDS, and similar services).

• Familiarity with the entire software development lifecycle, from design through production, monitoring, and on-call duties.

• Proficient in Python or extensive experience in Scala and Java.

• Knowledgeable about data stores utilized in event pipelines (e.g., Postgres/MySQL, Redis, DynamoDB, or similar).

• Experience with orchestrators like Apache Airflow.

• Proven history of managing high-throughput pipelines in production, addressing incidents, performance, cost, observability, data quality, and SLOs.

• Exceptional interpersonal and communication skills; able to articulate pipeline design and trade-offs to partners who utilize ZMP event data.

🏝️ Benefits

• Unlimited PTO.

• Comprehensive medical, dental, and vision insurance.

• Employee equity options.

• Employee discounts.

• Virtual wellness classes.

• Pet insurance.