
Observability Platform Engineer
Posted 16 hours ago

Posted 16 hours ago
This is a fully remote position, open to applicants in United Kingdom.
• Design and oversee telemetry pipelines using OpenTelemetry for metrics, logs, and traces, including SDKs, auto-instrumentation, and Collector configurations.
• Develop and manage Kafka-based streaming pipelines that reliably ingest, transform, and route telemetry at scale.
• Operate and scale Prometheus, encompassing exporters, service discovery, recording rules, and long-term storage solutions.
• Formulate alerting strategies with Alertmanager and PagerDuty, addressing routing, grouping, inhibition, escalation policies, and on-call schedules.
• Construct and sustain Apache Iceberg tables for historical telemetry and operational analytics, covering aspects like partitioning, schema evolution, compaction, and retention.
• Facilitate self-service querying and reporting via Amazon Athena, Amazon S3, and AWS Glue Data Catalog.
• Collaborate with engineering teams to enhance service instrumentation and establish SLIs, SLOs, and error budgets.
• Mitigate alert noise and enhance MTTD and MTTR by improving signal quality, runbooks, and automation.
• Participate in incident response and post-incident reviews, transforming insights into sustainable enhancements.
• Collaborate across development, SRE, and operations teams to ensure telemetry is reliable, scalable, cost-effective, and primed for analysis.
• 5+ years of experience in DevOps, SRE, platform, or observability engineering.
• Hands-on experience with OpenTelemetry, including Collector configuration, instrumentation, and OTLP.
• Strong understanding of Prometheus and PromQL, including recording and alerting rules, as well as exporters.
• Practical experience with Alertmanager and PagerDuty for alert routing, escalation, and on-call management.
• Extensive experience with Apache Kafka, covering topics, partitions, consumer groups, Kafka Connect, and performance tuning.
• Familiarity with Apache Iceberg or similar open table formats like Delta Lake or Apache Hudi.
• Experience in querying and optimizing data within Amazon Athena, alongside solid knowledge of Amazon S3 and AWS Glue.
• Good grasp of distributed systems, microservices, and cloud-native architectures.
• Proficiency in scripting or programming languages such as Python, Go, or Bash.
• Strong troubleshooting abilities and an automation-first approach.
• Intermediate English proficiency or above.
• Experience with Kubernetes and Helm, including the Prometheus Operator.
• Infrastructure as Code experience using Terraform.
• Familiarity with the Grafana stack, including Grafana, Loki, Tempo, or Mimir, or experience with Thanos/Cortex.
• Stream-processing experience with Kafka Streams, Apache Flink, or Apache Spark.
• Experience using Confluent Platform or Amazon MSK.
• Knowledge of SLO tooling and reliability practices, such as Sloth or Nobl9.
• Experience in optimizing costs related to observability and data workloads.
• Equal opportunities regardless of race, ethnicity, gender identity, sexual orientation, disability, age, religion, or any other characteristic.
• A respectful environment where everyone can express themselves, share their ideas, and feel a sense of belonging.
• Opportunities for career advancement through meaningful work, engaging projects, and collaborative success.
RTX
CSAA Insurance Group, a AAA Insurer
Supabase
Get handpicked remote jobs straight to your inbox weekly.