Senior Engineer – Observability Platform

This is a fully remote position, open to applicants in Louisiana, +4 more states.

📋 Description

• Create tailored software solutions for the observability platform utilizing Java Spring Boot, Python, and Go.

• Design, construct, and manage essential services for the observability platform.

• Drive organization-wide implementation of OpenTelemetry, encompassing client libraries, semantic conventions, instrumentation patterns, and Collector/agent strategies.

• Design, architect, and scale high-throughput, fault-tolerant telemetry pipelines for logs, metrics, and traces.

• Develop self-service observability features to facilitate onboarding, troubleshooting, and adoption.

• Implement comprehensive monitoring, SLOs, health checks, and alerting mechanisms for the observability platform.

• Set reliability benchmarks, error budgets, and incident response protocols in collaboration with SRE, Platform, and Cloud teams.

• Engage in on-call rotations, leading incident mitigation, root-cause analysis, and post-incident evaluations.

• Streamline operational workflows through tooling, CI/CD enhancements, and platform automation.

• Ensure the security of telemetry pipelines utilizing mTLS, secrets management, and zero-trust design methodologies.

• Create and maintain technical documentation, standards, and best practices.

• Collect requirements, influence roadmap prioritization, and implement platform enhancements.

• Provide technical leadership by mentoring, conducting design reviews, offering architectural guidance, and fostering cross-team collaboration.

⛳️ Requirements

• Minimum of 5 years of experience in Software Engineering.

• At least 3 years of experience with observability practices, including SLIs/SLOs/SLAs, alerting, and incident management.

• A minimum of 3 years developing production-grade backend services in Go and/or Java.

• At least 3 years of experience implementing and managing OpenTelemetry, including OTLP, semantic conventions, and instrumentation patterns.

• A minimum of 3 years working with cloud-native and containerized platforms, including Docker, Kubernetes, and Argo CD.

• At least 3 years of experience with public cloud platforms such as AWS, GCP, or Azure.

• Minimum of 2 years designing and scaling distributed, high-volume data pipelines.

• At least 2 years of experience with Infrastructure as Code tools like Terraform or CloudFormation.

• A minimum of 2 years with Helmcharts, Kustomize, or similar tools.

• At least 2 years working with Grafana OSS or comparable observability backends such as Grafana, Loki, Tempo, or Mimir.

• Minimum of 2 years with relational databases like PostgreSQL or MySQL.

• Bachelor’s degree from an accredited institution or equivalent work experience.

• Alternatively, a high school diploma plus 4 years of relevant experience.

• Preferred experience with service meshes, Envoy, Istio, commercial observability platforms, on-call scheduling tools, streaming/data platforms, time-series/NoSQL/analytical databases, cost optimization, chaos engineering, security-aware platform design, mentoring, 24x7 production systems, regulated environments, and cross-team technical communication.

🏝️ Benefits

• CVS Health bonus, commission or short-term incentive program in addition to base pay.

• Medical coverage.

• Dental coverage.

• Vision coverage.

• Paid time off.

• Retirement savings options.

• Wellness programs.

• Additional resources supporting physical, emotional, and financial well-being.

• Comprehensive benefits package for colleagues and their families, based on eligibility.