Senior Site Reliability Engineer – Fuse Team

This is a fully remote position, open to applicants in Slovakia, +1 more country.

📋 Description

• Become a member of the Fuse team responsible for managing item data capabilities that link Bloomreach Data Hub with Marketing, Search, Recommendations, and Loomi applications.

• Take ownership and enhance the reliability of Fuse services, including workers, APIs, queues, storage systems, and synchronization pipelines.

• Set up SLIs, SLOs, and error budgets for customer-facing APIs, asynchronous jobs, catalog freshness, synchronization, and indexing activities.

• Develop comprehensive observability for item collections, tracking everything from API requests and job submissions to processing, persistence, indexing, and downstream delivery.

• Design and maintain dashboards, alerts, and service health views utilizing tools like Grafana, Prometheus-compatible metrics, OpenTelemetry, PagerDuty, and GCP tooling.

• Enhance capacity planning and autoscaling by analyzing workload telemetry and customer traffic patterns.

• Improve the availability, scalability, and operability of systems such as PostgreSQL/Cloud SQL, Bigtable, Elasticsearch, GCS, Kafka, and related technologies.

• Assist with catalog placement, routing, index lifecycle, shard management, migrations, and recovery across Elasticsearch clusters.

• Define and automate data-consistency checks across source records, transformed items, job states, storage, indexes, and downstream destinations.

• Set platform limits and quotas for catalog size, API traffic, job concurrency, queue depth, payload size, and complex operations.

• Manage Kubernetes configuration and operational infrastructure for Fuse components.

• Enhance deployment automation, progressive rollout, rollback, release validation, CI/CD processes, security checks, and migration safety.

• Develop tools for local development, ephemeral environments, end-to-end testing, load testing, and production diagnostics.

• Maintain and verify executable runbooks.

• Engage in and enhance the Fuse L3/on-call rotation.

• Lead incident investigations, mitigation efforts, stakeholder communication, blameless reviews, and follow-ups.

• Create operational tools for job tracing, queue inspections, rate-limit diagnostics, catalog health checks, and index recovery.

• Minimize recurring support demands through safeguards, automation, tests, dashboards, and documentation.

• Assist in meeting ISO and SOC 2 security and compliance standards.

• Enforce least-privilege access, workload identity, authentication, authorization, secret rotation, encryption, auditability, customer isolation, and PII-handling protocols.

• Contribute to the design of new capabilities, ensuring reliability, recovery, observability, limits, and operational ownership are established early on.

• Review failure modes, retries, idempotency, backpressure, ordering, consistency, timeouts, cancellations, and rollout safety.

• Clarify ownership boundaries and service contracts among engineering teams.

• Mentor engineers on production readiness, operational testing, debugging, and sustainable on-call practices.

• Contribute to onboarding, domain mapping, dashboard and incident reviews, on-call shadowing, reliability improvements, SLI/SLO definitions, production-readiness assessments, incident reviews, and cross-team reliability initiatives.

⛳️ Requirements

• Extensive hands-on experience managing services on Kubernetes within a major cloud environment, preferably GCP.

• Strong background in observability and incident diagnosis for distributed systems.

• Proficiency in Go or Python; practical skills in both languages are a significant advantage.

• Experience operating at least one relational database, ideally PostgreSQL or Cloud SQL.

• Familiarity with large-scale data or indexing systems such as Bigtable, Elasticsearch/OpenSearch, Kafka, GCS, or similar technologies.

• Experience in designing or managing asynchronous job-processing systems, queues, workers, and retry mechanisms.

• Knowledge of CI/CD, Infrastructure as Code, deployment automation, and secure database migrations.

• Understanding of API reliability, rate limiting, backpressure, idempotency, and multi-tenant isolation.

• Willingness to participate in an on-call rotation and address production incidents.

• Ability to work effectively within a distributed, remote-first team environment.

• Practical experience with AI coding tools to expedite investigations and implementations while maintaining engineering judgment.

• Proven track record of reliability work that improves customer outcomes, engineering velocity, deployment confidence, or operational sustainability.

• Capability to lead ambiguous reliability initiatives and manage incidents from mitigation through root-cause analysis and prevention.

• Proficient in utilizing metrics, logs, traces, profiling, and workload data to form and validate hypotheses.

• Strong understanding of distributed systems, partial failure, capacity planning, throughput, latency, saturation, error rates, queue behavior, database performance, and storage growth.

• Preferred experience with catalog, product data, ingestion, transformation, or indexing platforms.

• Preferred experience with large Elasticsearch/OpenSearch clusters, including shard management, index lifecycle, routing, or reindexing.

• Preferred experience with Bigtable or another distributed wide-column database.

• Preferred experience in consistency validation across multiple storage or indexing systems.

• Preferred experience with customer-facing data APIs, high-volume bulk ingestion, or full and incremental synchronization.

• Preferred familiarity with product catalogs utilized by search, recommendations, marketing, or personalization systems.

• Preferred experience coordinating reliability enhancements across multiple engineering teams.

• Preferred knowledge of ISO, SOC 2, data isolation, retention, and audit requirements.

🏝️ Benefits

• Freedom and trust with no clocking in or out, corporate rules, or lengthy approval processes.

• Flexible working hours.

• Virtual-first work model with Bloomreach Hubs located on three continents.

• Company-sponsored events.

• Five paid days off for volunteering.

• People Development Program and personal development workshops.

• Support from a communication coach.

• Leader Development Program that includes feedback, coaching, and check-ins.

• An annual professional education budget of $1,500 for books, courses, certifications, etc.

• Employee Assistance Program featuring counseling services.

• Subscription to Calm.

• One additional DisConnect day off each quarter.

• Opportunities for sports, yoga, and meditation.

• Extended parental leave of up to 26 calendar weeks for Primary Caregivers.

• Options for Restricted Stock Units or Stock Options, depending on role, seniority, and location.

• Performance-based company bonus.

• Employee referral bonuses of up to $3,000.

• Recognition rewards for work anniversaries.