
Senior Data Science Engineer, LLM & NLP
Posted 6 hours ago

Posted 6 hours ago
This is a fully remote position, open to applicants in Poland.
• Conduct research, develop, and implement LLM, NLP, and ML models.
• Create model-driven services that support conversational AI solutions.
• Manage the entire development lifecycle, from identifying problems and exploring data to model development, evaluation, and production deployment.
• Develop conversational AI features, including multi-turn dialogue, context management, and answer generation using financial data.
• Utilize prompt engineering, structured outputs, tool usage, and agent workflows.
• Construct RAG pipelines for financial documentation.
• Fine-tune or train proprietary LLMs when API models are inadequate.
• Minimize hallucinations, latency, and cost per request.
• Train, fine-tune, and maintain BERT-based NLP models for intent detection, classification, entity extraction, and embeddings.
• Prepare and label datasets.
• Assess when smaller specialized models should be employed instead of LLM calls.
• Develop Python services within a microservices architecture comprising over 20 components.
• Implement model routing, fallbacks, retries, caching, and rate-limit management.
• Design versioned REST APIs and uphold clean, tested code through code reviews.
• Generate quality metrics and evaluation datasets.
• Execute automated evaluations, including using LLMs as judges and performing regression tests for prompt/model modifications.
• Track LLM calls and carry out experiments and A/B testing.
• Train, deploy, and manage models on AWS, utilizing services such as EKS, Lambda, S3, SageMaker, and GPU instances.
• Implement CI/CD for models and prompts in conjunction with DevOps, while monitoring and reducing costs.
• Collaborate with product, backend, DevOps teams, and financial domain specialists.
• Contribute to decisions regarding architecture and modeling.
• Over 5 years of commercial experience in Data Science, Machine Learning, or AI Engineering.
• More than 3 years of hands-on experience with LLMs and NLP.
• Strong proficiency in Python, OOP, and software engineering principles.
• Skilled in prompt engineering with experience in evaluating LLMs.
• Solid understanding of contemporary deep-learning architectures; practical experience with PyTorch or TensorFlow.
• Familiarity with SQL and NoSQL databases.
• Experience with Docker and containerized applications; deploying and managing services on Kubernetes.
• Regular use of AI coding tools (such as Claude Code, Cursor, or similar).
• Proficient in English at an upper-intermediate level or above (both spoken and written).
• Fluency in Ukrainian.
• Bachelor's degree or higher in Computer Science, Software Engineering, or a related discipline.
• Preferred: Knowledge of RAG, vector databases, and semantic search.
• Preferred: Experience in fine-tuning or training LLMs.
• Preferred: Familiarity with cloud platforms (AWS, GCP, Azure).
• Preferred: Experience with LangChain, LangGraph, LlamaIndex, or similar tools.
• Preferred: Knowledge of observability tools including Grafana, Prometheus, Langfuse, LangSmith.
• Preferred: Understanding of financial markets, fintech, or trading domain.
• Preferred: Background in mathematical optimization (LP/MILP, constraint programming).
• Preferred: Participation in Kaggle competitions.
• Utilize proprietary AI models and advanced language technologies to provide critical insights on global stocks in multiple languages.
• Integrate generative AI technology into brokerage platforms and financial institutions.
Counterpart
Oportun
CVS Health
Get handpicked remote jobs straight to your inbox weekly.