
Senior Data Scientist
Posted 6 days ago

Posted 6 days ago
This is a fully remote position, open to applicants in Ireland.
• Design, develop, assess, and implement intricate AI/ML solutions autonomously.
• Utilize machine learning and statistical modeling for classification, regression, ranking, forecasting, clustering, anomaly detection, and enterprise agentic AI applications.
• Create and assess intent classification, semantic matching, agent/skill/tool ranking, and model-routing techniques.
• Estimate execution latency, token demand, inference costs, workload patterns, and resource needs.
• Perform exploratory analysis, dataset preparation, feature engineering, hypothesis testing, and reproducible experiments.
• Assess commercial APIs and self-hosted open-weight models for accuracy, reasoning, adherence to instructions, structured outputs, latency, throughput, and cost.
• Develop prompts, few-shot examples, tool-calling prompts, and context assembly strategies.
• Design and enhance RAG parsing, chunking, metadata, embedding, retrieval, reranking, and context selection.
• Diagnose retrieval and generation failures while measuring retrieval and answer-quality metrics.
• Evaluate and apply prompting, RAG, supervised instruction fine-tuning, SFT, LoRA, QLoRA, and similar adaptation techniques.
• Curate instruction datasets and holdout evaluations while validating fine-tuned model artifacts and adapters.
• Analyze agent routing, MCP tool selection, workflow selection, planning, task completion, tool-call accuracy, delegation, and failure recovery.
• Create golden datasets, holdout sets, human review protocols, LLM-as-judge calibration, and statistical comparison methods.
• Automate evaluations and regression checks for models, prompts, RAG, fine-tuning, routing, and agents.
• Implement reproducible experimentation, model evaluation, and lifecycle workflows with automated validation and production-readiness assessments.
• Develop automated training, fine-tuning, benchmarking, and evaluation pipelines along with model registries and artifact traceability.
• Define quality gates, regression tests, release-readiness criteria, monitoring, and remediation recommendations.
• Collaborate with AI Engineering, AI Quality, Platform Engineering, Product Management, and subject matter experts.
• Lead intricate Data Science initiatives from problem identification through to production handoff.
• Transform business requirements into quantifiable AI/ML objectives.
• Mentor junior and mid-level Data Scientists and convey complex concepts to both technical and non-technical stakeholders.
• Develop tools that assist customers in transitioning from competitor products to BMC solutions, minimizing manual effort and facilitating accurate, timely migrations.
• Over 8 years of relevant experience in Data Science, Machine Learning, or Applied AI.
• Bachelor's degree in Machine Learning, Statistics, Data Science, Physics, Computer Science, or a related area, or equivalent education and industry experience.
• Advanced proficiency in Python, particularly with Pandas, NumPy, scikit-learn, and PyTorch or TensorFlow; SQL and practical skills in data preparation.
• Strong knowledge of statistics, experimental design, hypothesis testing, ML validation, and applied techniques in classification, regression, ranking, clustering, forecasting, and anomaly detection.
• Hands-on experience with LLM prompting, embeddings, model comparison, and RAG design/optimization, including chunking, retrieval, and reranking.
• Practical experience in instruction fine-tuning or parameter-efficient model adaptation, with measurable baseline comparisons.
• Experience in designing evaluation datasets, automated quality metrics, and conducting statistical model/LLM/RAG experiments.
• Proficient in MLOps and LLMOps, including experiment tracking, model/dataset/prompt versioning, reproducible pipelines, registries/artifacts, evaluation automation, quality gates, and monitoring.
• Working knowledge of agent planning, routing, tool calling, MCP, A2A, and multi-agent patterns.
• Understanding of inference latency, throughput, concurrency, token costs, and the trade-offs between on-premises versus provider-hosted models.
• Familiarity with AWS and/or Kubernetes or Red Hat OpenShift (OCP), along with experience collaborating with platform engineering.
• Excellent communication skills, ability to solve problems independently, collaborate across functions, and mentor others.
• Proven ability to independently deliver complex AI/ML solutions, make informed technical decisions within assigned projects, and mentor fellow Data Scientists.
• Experience contributing to reusable modeling, evaluation, and MLOps/LLMOps practices within project teams.
• Nice-to-have: Experience with OpenSearch, Elasticsearch, FAISS, Milvus, pgvector, or similar retrieval platforms.
• Nice-to-have: Familiarity with LangGraph, OpenAI Agents SDK, Google ADK, CrewAI, or other agentic frameworks.
• Nice-to-have: Knowledge of MLflow, Kubeflow, Ragas, DeepEval, OpenJudge, LangSmith, or similar tools.
• Nice-to-have: Experience with vLLM, NVIDIA Triton, quantization, GPU memory sizing, or distributed inference.
• Nice-to-have: Skills in Python backend APIs, OpenTelemetry, and AI observability.
• Nice-to-have: Knowledge of AI safety, prompt injection evaluation, privacy, responsible AI, and model governance.
• Nice-to-have: Understanding of enterprise code, legacy modernization, or domain-specific model adaptation.
• Nice-to-have: Familiarity with Agile practices and Atlassian Jira/Confluence.
• A Master's degree in a related field is a plus.
• Information regarding benefits is accessible via the employer's benefits page; specific benefits are not enumerated in this posting.
• Occasional business travel may be necessary.
• Equal opportunity employment is upheld.
• Reasonable accommodations are available during the application and hiring processes.
Commit
Counterpart
Oportun
Get handpicked remote jobs straight to your inbox weekly.