Architect, GenAI

This is a fully remote position, open to applicants in Illinois, +1 more state.

📋 Description

• Independently manage high-impact, client-facing projects while supervising the efforts of junior consultants and engineers.

• Develop and enhance LLM applications, including AI Agents, RAG systems, evaluation pipelines, prompt chaining, and output refinement.

• Create, implement, and deploy GenAI pipelines utilizing tools such as DSPy, MLFlow, LangChain, LlamaIndex, and Databricks Mosaic AI.

• Engage directly with models such as OpenAI GPT, LLaMA, Claude, among others—performing fine-tuning or prompt-tuning as necessary.

• Ingest and manage both unstructured and structured data for GenAI systems, covering document parsing, chunking, vectorization, and retrieval.

• Collaborate with cross-functional teams to develop bespoke UI and API integrations, as well as GenAI-enhanced user experiences.

• Apply enterprise-level best practices for security, compliance, evaluation, and governance in all GenAI initiatives.

• Create evaluation frameworks using MLFow, Mosaic AI Eval tools, along with standard and custom metrics.

• Assist with CI/CD and DABs for AI applications, facilitating the promotion of code and model artifacts across various environments.

• Contribute to the development of internal accelerators and reusable GenAI components as part of our expanding framework library.

• Collaborate closely with senior leadership to devise architecture and delivery plans aligned with client requirements.

• Develop strategic data initiatives that align with client business goals and industry best practices.

• Lead technical discovery sessions, shape solution architectures, respond to RFPs, and present demos and proofs of concept for GenAI projects.

⛳️ Requirements

• Bachelor’s degree in Computer Science or a related technical discipline.

• Over 7 years of experience in Machine Learning or NLP; with a minimum of 2 years focusing on Generative AI systems, ideally within Databricks.

• Proficient in open-source LLM tools such as Hugging Face Transformers, LangChain, or comparable orchestration libraries.

• Strong practical experience with Databricks (Unity Catalog, MLFlow, Delta Tables, etc.).

• Acquainted with GenAI-specific challenges, including hallucination mitigation, grounding techniques, and evaluation frameworks.

• Background in designing and launching applications that prioritize security, compliance, and scalability.

• Exceptional communication capabilities and a solid ability to interact with both technical and business stakeholders.

🏝️ Benefits

• Engaging, innovative projects in Generative AI with clients spanning various industries—from Fortune 100 companies to disruptive startups.

• Accelerated learning and mentorship opportunities with AI/GenAI thought leaders and practitioners.

• An environment that fosters experimentation, innovation, and continuous enhancement.

• Opportunities to serve as a conference speaker, blogger, or writer.

• A diverse, inclusive team and one of the premier GenAI teams, where your voice, ideas, and contributions are highly valued.