Senior Observability Engineer

This is a fully remote position, open to applicants in India.

📋 Description

• Act as the subject matter expert for the Dynatrace observability platform.

• Enhance proactive monitoring capabilities through effective signal quality engineering and reduction of operational noise.

• Serve as a technical liaison among Hosting Operations, Site Reliability Engineering, and various engineering teams.

• Design and manage the configuration of the Dynatrace multi-tenant environment, which includes management zones, alerting profiles, metric and custom events, tagging strategies, and access boundaries.

• Take ownership of the complete alert lifecycle, covering ownership, naming conventions, severity mapping, alert disposition taxonomies, and production-readiness criteria.

• Mitigate alert fatigue by refining tuning, thresholds, correlation, suppression, and retiring alerts while ensuring coverage for issues that impact clients.

• Develop and implement synthetic monitors and business-centric service-health models for vital client journeys and access paths.

• Create and standardize Dynatrace Query Language queries, notebooks, and dashboards for operational, leadership, and reliability reporting purposes.

• Oversee observability configurations utilizing configuration-as-code practices, ensuring monitoring setups are version-controlled, peer-reviewed, and reproducible.

• Improve alert-to-ticket enrichment, including integrations with Salesforce ITSM, by providing context and probable causes.

• Collaborate with SQL, platform, OS, and API experts to identify monitoring blind spots and ensure alerts are accompanied by thorough runbooks.

• Set reporting baselines for P1–P4 service-level measurements and align noise-reduction changes with operational guardrails.

• Maintain reference materials, standard operating procedures, and observability standards documentation in Confluence.

• Execute additional responsibilities that support the overall objectives of the role.

⛳️ Requirements

• Bachelor’s Degree in Computer Science, Information Technology, or a related technical discipline, or a combination of education and experience that meets the required qualifications.

• Over 7 years of experience in observability, application performance monitoring (APM), monitoring engineering, site reliability engineering (SRE), or closely related technology infrastructure.

• Practical expertise with the Dynatrace platform, including Davis AI, DQL, dashboards, notebooks, management zones, alerting profiles, metric/custom events, and synthetic monitors.

• Proven experience in designing, configuring, and fine-tuning enterprise-scale alerting systems to minimize noise while retaining detection capabilities.

• Background in integrating monitoring systems with enterprise ITSM/ticketing systems like Salesforce for automated ticket routing and enrichment.

• Experience working in highly regulated hosting environments, such as healthcare, HIPAA/HITRUST, SOC 2, or ISO 27001.

• Dynatrace certification or a commitment to obtain certification within one year of employment.

• Strong knowledge of AWS infrastructure, Windows and Linux operating systems, and SQL Server database concepts.

• Advanced understanding of cloud-native observability frameworks, APM tools, particularly Dynatrace, and alert lifecycle management.

• Proficient in AWS cloud computing, systems integration, database operations, and scripting languages such as Python or PowerShell.

• Exceptional problem-solving abilities.

• Strong written and verbal communication skills.

• Highly organized, detail-oriented, self-motivated, and possess a strong ownership mindset.

• Capability to translate complex technical infrastructure metrics into direct service and business impacts.

• Ability to collaborate effectively with operations command analysts, SRE partners, database specialists, and leadership.

🏝️ Benefits

• Equal opportunity employer.

• Inclusive and diverse work environment.