This is a fully remote position, open to applicants in California, +2 more states.

📋 Description

• Design and enhance Rust-based data processing frameworks tailored for large datasets within GPU-accelerated environments that facilitate LLM training.

• Spearhead the development and iterative refinement of components within the Agentic Retrieval pipeline, focusing on GPU optimization and model performance enhancement.

• Collaborate with LLM and ML researchers to create comprehensive, GPU-accelerated data preparation pipelines for multimodal models.

• Conduct benchmarking, profiling, and optimization of algorithms in Python across various system architectures for LLM applications.

• Grasp project requirements, construct and assess proofs of concept, and formulate roadmaps for production tools and library functionalities.

• Develop products aimed at enhancing employee productivity through generative AI and co-pilot experiences.

• Create integrated systems that deliver seamless experiences across applications and provide end-to-end user insights.

• Assist in constructing and maintaining Continuous Delivery pipelines to accelerate and secure the deployment of changes to production.

• Conduct peer reviews focusing on performance, scalability, and accuracy; contribute to the establishment of frameworks, standards, and technology adoption.

⛳️ Requirements

• Bachelor's or Master's Degree in Computer Science, Computer Engineering, or a related discipline (or equivalent experience).

• Over 6 years of experience in a similar or related position.

• Proven experience in delivering software within a cloud environment and familiarity with managing cloud infrastructure.

• Proficient knowledge of MLOps technologies, including Docker-Compose, Containers, Kubernetes, and data center deployments.

• Extensive hands-on expertise in NLP, LLM, VLM, Generative AI, and Agentic Retrieval workflows.

• A strong enthusiasm for growth, continuous learning, and sharing insights with the team.

• Excellent communication skills to simplify complex topics into clear, impactful conclusions.

• Capability to collaborate effectively with multifunctional teams, principals, and architects; coordinate across organizational boundaries and regions.