AI Ops Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Create, develop, and refine LLM-powered and agentic AI solutions tailored for enterprise Infrastructure & Operations applications.

• Design and implement domain-specific AI agents to address inquiries, facilitate operational investigations, and streamline defined workflows.

• Construct MCP integrations and tool-calling functionalities that connect AI agents to enterprise platforms and APIs.

• Develop backend services and integrations, primarily utilizing Python and REST APIs.

• Integrate the AI platform with ServiceNow/CMDB, Dynatrace, Zabbix, and GCP.

• Establish pipelines and services to ingest, normalize, enrich, and contextualize operational data.

• Apply RAG and grounding methodologies to ensure accurate enterprise context.

• Create read-only AI workflows for incident triage, incident management, RCA, infrastructure discovery, and Help Desk automation.

• Expand workflows towards controlled automation, proactive outage prevention, and coordinated self-healing.

• Implement guardrails, validation measures, access controls, and human-in-the-loop methodologies.

• Utilize AI-assisted engineering tools to enhance software development and automation processes.

• Establish AI observability and evaluation capabilities to measure quality, confidence, token consumption, reliability, latency, and MTTR.

• Collaborate with architects, platform engineers, observability teams, IT operations, search, data, and security experts.

• Enhance knowledge quality and cross-validation techniques to minimize hallucinations.

• Contribute to secure, scalable, observable, and maintainable enterprise AI engineering standards and practices.

⛳️ Requirements

• 3–5 years of relevant engineering experience.

• 1–2 years of hands-on experience with Generative AI/LLM.

• 2–3 years of foundational experience in backend software, Python, API integration, data, cloud, automation, or AIOps.

• Strong proficiency in Python programming and experience with production backend services.

• Extensive experience in designing, building, and utilizing RESTful APIs.

• Practical understanding of LLMs, prompt engineering, context management, embeddings, vector retrieval, and RAG.

• Hands-on experience with agentic or multi-agent frameworks such as LangChain/LangGraph, AutoGen, CrewAI, or similar technologies.

• Familiarity with MCP, function/tool calling, agent registries, and AI orchestration methodologies.

• Experience with modern AI coding assistants or autonomous development tools like Devin or Windsurf.

• Knowledge of ServiceNow/CMDB, Dynatrace, Zabbix, and/or GCP.

• Understanding of ITSM, incident management, observability, monitoring, infrastructure telemetry, or AIOps.

• Experience handling structured and unstructured data for AI applications.

• Knowledge of AI safety, data governance, security, access control, grounding, hallucination mitigation, and responsible AI practices.

• Experience in designing or managing reliable, scalable, observable, and maintainable production systems.

• Ability to comprehend complex enterprise environments and translate operational requirements into technical solutions.

• Strong collaboration skills with architects, engineers, infrastructure, IT operations, security, and other technical stakeholders.

• Comfortable delivering phased solutions from read-only AI assistance to controlled automation and agentic execution.

• Willingness to work onsite at corporate or client locations as required.

• For positions that involve travel or event participation, a valid driver’s license and a satisfactory driving record are necessary.

🏝️ Benefits

• Competitive salary package.

• Share plan.

• Company performance bonuses.

• Value-based recognition awards.

• Referral bonus.

• Career coaching.

• Global career opportunities.

• Non-linear career paths.

• Internal development programs for management and technical leadership.

• Engaging projects.

• Rotations.

• Access to internal tech communities.

• Training opportunities.

• Certification programs.

• Coaching services.

• Subscriptions to online learning platforms.

• Pass-it-on sessions.

• Workshops.

• Conferences.

• Hybrid work arrangements.

• Flexible working hours.

• Employee assistance program.

• Global internal well-being program.

• Access to well-being applications.

• Hobby clubs and interest groups.

• Inclusion and diversity initiatives.

• Events and celebrations.

• Comprehensive medical, dental, vision, and disability coverage.

• Flexible Spending Accounts for medical, transit, and dependent care.

• Employer-paid life insurance and AD&D coverages.

• Health Savings Account paired with our low-cost High Deductible Medical Plan.

• 401(k) Safe Harbor Retirement plan with employer matching and immediate vesting.