Senior Software Engineer – AI, CoCounsel

This is a fully remote position, open to applicants in New York, +2 more states.

📋 Description

• Create and deploy AI-driven solutions specifically designed for legal processes, including contract analysis, litigation assistance, discovery automation, and regulatory evaluations.

• Develop scalable, secure, and maintainable AI systems according to the architectural frameworks established by the AI Solutions Architect, incorporating RAG pipelines, custom agents, and enterprise integrations.

• Construct and configure multi-step agentic workflows utilizing CoCounsel, Westlaw, Practical Law, third-party AI APIs, and enterprise systems.

• Establish observability, evaluation, and quality control measures for production AI systems, which include monitoring, tracing, benchmarking, and red-teaming protocols.

• Engage in technical discovery sessions with clients and legal stakeholders, converting legal workflows and business objectives into precise engineering plans and prototypes.

• Collaborate closely with AI architects, legal AI engineers, and colleagues to deliver high-quality solutions, share reusable assets, and enhance engineering practices throughout the team.

• Assess and prototype new AI methodologies, interoperability standards, and prompt engineering strategies to elevate solution quality and expedite delivery.

⛳️ Requirements

• Over 5 years of software engineering experience with a robust background in system design, distributed systems, and clean architecture.

• A minimum of 2 years of practical experience in building and deploying AI/ML or LLM-powered applications in a production setting.

• Strong expertise in Python and backend development, with a track record of creating RESTful APIs, asynchronous services, and event-driven systems.

• Familiarity with orchestration frameworks such as LangChain, LangGraph, PydanticAI, or AutoGen, along with a solid understanding of RAG architectures and vector databases.

• Experience with cloud service providers such as AWS, Azure, or GCP, in addition to knowledge of Infrastructure as Code, CI/CD practices, and secure API development.

• Proficiency in observability and AI evaluation tools like Datadog, Grafana, Prometheus, LangSmith, Langfuse, Braintrust, or Weights & Biases.

• Excellent communication abilities and comfort in working independently within ambiguous, client-facing settings, including collaboration with legal professionals and non-technical stakeholders.

🏝️ Benefits

• Flex My Way supportive workplace policies.

• Flexible working arrangements, enabling work from anywhere for up to 8 weeks per year.

• Career Development and Growth programs.

• Comprehensive benefit packages, including flexible vacation, Mental Health Days off, access to the Headspace app, retirement savings, tuition reimbursement, and employee incentive programs.

• Resources for mental, physical, and financial wellbeing.

• Two paid volunteer days off each year.

• Opportunities for pro-bono consulting projects.

• Commitment to Environmental, Social, and Governance (ESG) initiatives.

• Competitive health, dental, vision, disability, and life insurance plans.

• Attractive 401k plan with company matching.

• Optional hospital, accident, and sickness insurance (100% covered by the employee).

• Optional life and AD&D insurance (100% covered by the employee).

• Flexible Spending and Health Savings Accounts.

• Fitness reimbursement.

• Access to the Employee Assistance Program.

• Group Legal Identity Theft Protection benefit (100% covered by the employee).

• Access to 529 Plan.

• Commuter benefits.

• Adoption & Surrogacy Assistance.

• Employee Stock Purchase Plan.