Senior Engineer, Data Services

This is a fully remote position, open to applicants in United States.

📋 Description

• Take full ownership of intricate engineering tasks from initial design through to implementation, testing, and production.

• Develop clean, thoroughly tested, maintainable code while adhering to code review best practices.

• Create and evaluate Technical Design Documents and contribute to Architecture Decision Records.

• Facilitate technical discussions and document architectural trade-offs effectively.

• Construct and manage the Common Event Bus, including aspects such as event validation, enrichment, EventBridge routing, cross-account targets, DLQ handling, replay, and Iceberg lakehouse integration.

• Oversee Kafka/Debezium change-data-capture pipelines and Benthos jobs.

• Manage event and API contracts, schema definitions, generated bindings, versioning, and compatibility within trueml-model (OTDS).

• Develop production Terraform deployed via Atlantis across sandbox, development, staging, and production environments.

• Utilize and enhance AI coding agents, repository context, MCP servers, and reusable agent workflows.

• Contribute to LLM-backed services, focusing on prompt/context design, structured output, tool calling, validation loops, model selection, token budgets, and cost management.

• Implement observability metrics in pipelines, including delivery rates, validation failures, DLQ depth, and latency.

• Promote reliability and operational health enhancements.

• Mentor junior engineers through code reviews, pairing, and direct guidance.

• Lead exploratory spikes and time-constrained discovery initiatives.

• Collaborate with Data Engineering, Data Science, and Product teams on data contracts, schema modifications, and onboarding event publishers and subscribers.

• Engage in discussions regarding code quality, testing, operational readiness, documentation, and FinOps.

⛳️ Requirements

• A Bachelor's degree in a relevant technical discipline or equivalent practical experience.

• Over 5 years of experience in software or data engineering.

• Proven track record of ownership over production systems.

• Extensive experience with event-driven architecture, encompassing event buses, schema evolution, idempotency, dead-letter handling, and replay mechanisms.

• Practical experience with EventBridge, SNS/SQS, Kinesis, and/or Kafka with a schema registry.

• Strong foundational knowledge in multi-account AWS services, including Lambda, IAM, S3, Glue Catalog, Athena, Firehose, and Iceberg.

• Proficient in production-grade Go or TypeScript.

• Openness to working within the JVM for legacy platform systems.

• Experience with Terraform at a production scale.

• Regular use of agentic coding tools such as Claude Code or similar.

• Practical knowledge of MCP; ideally having built an MCP server.

• Direct experience with LLM APIs such as Bedrock or Anthropic.

• Familiarity with prompt and context engineering, structured output, tool invocation, evaluation, and guardrails.

• Capability to analyze model tiers, token budgets, and associated costs.

• Experience handling PII, tokenization, and least-privilege access within regulated environments.

• Awareness of prompt injection and overly broad agent permissions as potential security vulnerabilities.

• Capacity to work autonomously and enhance systems with limited documentation.

• Ability to draft clear technical design documents and articulate technical trade-offs to non-engineers.

🏝️ Benefits

• Flexible vacation policy.

• Comprehensive medical, dental, and vision insurance.

• Options for traditional and Roth retirement savings.

• Company-covered disability and life insurance.

• Flexible Spending Account & Limited FSA options.

• Family-friendly parental leave policy.

• Time off for volunteering and voting.

• Access to an on-demand wellness platform for you and up to 5 friends and family members.

• PerkSpot discount program offering savings at over 900 merchants nationwide.

• Remote-first work environment.

• Reasonable accommodations available for individuals with disabilities.