Senior ML Operations Engineer

This is a fully remote position, open to applicants in Ukraine, +4 more states.

📋 Description

• Act as an enabler for development teams by establishing streamlined processes that eliminate obstacles and enhance creativity and innovation.

• Collaborate with fellow engineers, product managers, and internal stakeholders within an Agile framework.

• Offer mentorship, technical advice, and conduct code evaluations for team members.

• Design and execute projects from start to finish with minimal supervision.

• Assist teams in building and deploying AI applications by resolving common challenges in the MLDLC.

• Continuously learn and exhibit enthusiasm for discovering new tools, technologies, libraries, and frameworks (both commercial and open source) that can enhance PitchBook’s AI capabilities.

• Uphold the company’s vision and values by modeling desired behaviors and encouraging them in others.

• Engage in various cross-functional company initiatives and projects as needed.

• Contribute to strategic planning to ensure the team develops exceptional products that offer genuine business value.

• Assess frameworks, vendors, and tools to optimize processes and reduce costs with minimal oversight.

⛳️ Requirements

• A degree in Computer Science, Information Systems, Machine Learning, or a related field is preferred (or equivalent practical experience).

• Over 5 years of hands-on software development experience with Python (candidates with Java experience and strong Python skills will also be considered).

• More than 4 years of experience in designing and constructing distributed software systems and architectures.

• At least 3 years of hands-on experience in deploying and managing Machine Learning services in a production environment.

• Experience in supporting ML lifecycle operations, including post-deployment monitoring and maintenance.

• Familiarity with cloud-native technology stacks and a practical understanding of containerization technologies such as Kubernetes and Docker.

• Proven experience in SQL and NoSQL database design and implementation.

• Ability to break down complex issues into iterative, clearly defined solutions.

• Strong problem-solving skills focused on creating scalable, efficient, and maintainable systems.

• Excellent communication and collaboration skills, able to effectively engage with internal customers across diverse cultures and regions.

• Capacity to be a team player while also working independently.

• Experience collaborating across multiple development teams is advantageous.

• Bonus points for:

• Experience with cloud platforms such as AWS, Google Cloud Platform, or Azure.

• Proficiency in GitOps practices and the development and management of CI/CD pipelines.

• Experience with observability and monitoring tools (e.g., Prometheus, Grafana) and building instrumented, production-ready systems.

• Experience managing and provisioning Large Language Models through managed services (e.g., Azure OpenAI, Google Vertex AI, Amazon Bedrock).

• Hands-on experience with LLM gateways (e.g., LiteLLM) and agentic frameworks (e.g., LangGraph, LangSmith, or similar).

• Practical experience with vector embedding models and vector databases (e.g., Pinecone, Weaviate, Milvus, pgvector).

• Experience in developing Retrieval-Augmented Generation systems and assessing both retrieval quality and generation performance.

• Cloud-native experience with services like Amazon SageMaker, Google Vertex AI, or Azure ML.

• Familiarity with ML frameworks and tools, including PyTorch, TensorFlow, and scikit-learn.

• Experience with data infrastructure technologies such as Redis, Elasticsearch, and Apache Kafka.

• ML experiment tracking and model management experience with tools like Weights & Biases, MLflow, or KubeFlow.

• API development experience with FastAPI or similar frameworks.

• Java programming experience is a plus.

🏝️ Benefits

• Comprehensive health insurance, including medical, dental, and vision coverage.

• Generous paid time off policy, including vacation and sick leave.

• Flexible working hours and remote work options.

• Opportunities for professional development and continuous learning.

• A collaborative and innovative work environment.