Senior Elastic ML, Gen AI Engineer

This is a fully remote position, open to applicants in India.

📋 Description

• Design, develop, and expand machine learning and generative AI solutions utilizing the Elastic Stack.

• Take ownership of the ML and Gen AI functionalities from start to finish—covering everything from anomaly detection and semantic search to vector-driven RAG.

• Create and execute Elastic ML solutions, including anomaly detection, data frame analytics, and forecasting.

• Develop semantic and hybrid search capabilities using vector search, dense/sparse vectors, and ELSER technology.

• Construct Gen AI / RAG pipelines employing Elasticsearch as a vector storage solution.

• Deploy and oversee NLP and transformer models within Elasticsearch through Eland.

• Design data models, mappings, and ingestion processes that are optimized for vector and ML workloads.

• Fine-tune relevance, embeddings, and retrieval quality; assess and enhance search/RAG performance.

• Create Kibana dashboards and ML tasks for monitoring, alerting, and providing explanations.

• Collaborate with data, platform, and product teams to operationalize ML/Gen AI features on a large scale.

⛳️ Requirements

• Over 5 years of experience in ML/AI or data engineering, possessing strong practical experience with the Elastic Stack.

• Proven skills in Elastic ML (including anomaly detection and data frame analytics) along with the inference/NLP capabilities of Elasticsearch.

• Extensive experience with vector search, embeddings, semantic/hybrid search, and ELSER.

• Practical experience in Gen AI / RAG, including LLM integration, prompt design, retrieval pipelines, and grounding.

• Proficient in Python and ML libraries such as PyTorch, Hugging Face, and Azure OpenAI.

• Skilled in Elasticsearch DSL/ES|QL and managing large-scale data.

• Experience working in cloud environments (AWS/Azure/GCP) and familiarity with containers and Kubernetes.

🏝️ Benefits

• Flexible and supportive work environment.

• Be Well programs thoughtfully designed to support your financial, mental, physical, and social well-being.

• Unique opportunities that include hands-on experience, learning prospects, and certification.

• A culture that emphasizes empathy, continuous learning, and a commitment to collective success.