Generative AI Engineer

This is a fully remote position, open to applicants in Maryland.

📋 Description

• Design, create, test, implement, and sustain an AI-driven decision-support system for the exploration and navigation of statutes, regulations, rules, and guidance utilizing natural language.

• Develop, manage, and maintain generative AI solutions based on authoritative source documentation.

• Construct and uphold document ingestion pipelines, which encompass parsing, chunking, metadata tagging, embedding generation, and vector/semantic search indexing.

• Collaborate with project managers, data engineers, full stack developers, analysts, subject matter experts, and client stakeholders.

• Convert user requirements into specifications, prompts, and evaluation criteria.

• Generate responses that include source citations and direct links to the relevant documentation.

• Create and enforce guardrails, which include content filtering, scope limitations, PII/PHI protections, and handling of refusals.

• Formulate evaluation frameworks and test sets to assess retrieval quality, answer accuracy, groundedness, and consistency.

• Monitor and optimize performance over time.

• Deploy and manage solutions within authorized AWS services and adhere to federal security protocols.

• Assist in documentation for security authorization and AI governance evaluations.

• Implement logging, monitoring, and audit trails to ensure transparency, manage costs, and ensure responsible AI oversight.

• Write clean, reusable, and well-documented code.

• Engage in code reviews, testing, and deployment activities.

• Keep abreast of emerging AI technologies, models, and federal AI guidelines.

⛳️ Requirements

• Master’s degree in computer science, data science, engineering, or a related field.

• Over 5 years of experience in software and cloud-based solution development.

• Recent experience in designing and deploying LLM or generative AI applications.

• Strong expertise in Python.

• Familiarity with modern LLM APIs, SDKs, orchestration frameworks, and AI/ML libraries, including Hugging Face, LangChain, or LlamaIndex.

• Practical experience with embeddings, vector databases, and hybrid/semantic search.

• Knowledge of AWS AI and data services, such as Amazon Bedrock, Amazon OpenSearch, Amazon Kendra, SageMaker, Lambda, or S3.

• Experience with prompt and context engineering, LLM evaluation, hallucination mitigation, and grounded responses.

• Background in designing AI applications that utilize multiple foundation models/providers and assessing accuracy, latency, cost, security, and use-case suitability.

• Proficient in Agile software development practices.

• Experience in building and maintaining CI/CD pipelines, testing, and infrastructure deployment using GitHub Actions, CloudFormation, Terraform, and/or Jenkins.

• Excellent problem-solving abilities and communication skills.

• Capability to explain AI functionalities and limitations to non-technical stakeholders.

• Ability to work autonomously and collaboratively, with a keen eye for detail and presentation.

• Preferred: Experience in supporting federal health programs.

• Preferred: Experience in deploying AI solutions within federal environments, including FedRAMP-authorized services, ATO/security authorization procedures, and NIST 800-53 controls.

• Preferred: Knowledge of responsible AI practices and federal AI governance frameworks.

• Preferred: Understanding of HIPAA and HITECH regulations.

• Preferred: Experience in developing conversational or search interfaces, including compliance with Section 508 accessibility standards.

• Preferred: Relevant AWS certification or equivalent qualifications.

🏝️ Benefits

• Comprehensive health insurance plans.

• Flexible working hours and remote work options.

• Professional development opportunities and training programs.

• Competitive salary and performance-based bonuses.

• Generous vacation and paid time off policies.

• Retirement savings plans with employer matching.