Software Engineer, AI Systems

📋 Description

• Collaborate closely with product managers and subject matter experts to gain a comprehensive understanding of the review process, user needs and challenges, translating these insights into technical solutions.

• Design and implement AI-driven system components, which includes creating data ingestion pipelines, developing retrieval systems to surface pertinent content, designing prompt workflows, and managing multi-step interactions between LLMs and external tools.

• Develop internal tools and interfaces that empower users to engage with AI-generated outputs, facilitating evidence review, result refinement, and contributions to final outputs.

• Construct and optimize data pipelines and storage solutions to accommodate large, multi-modal curriculum datasets (such as long-form PDFs, web content, and embedded media), incorporating metadata tagging and efficient retrieval mechanisms.

• Establish and execute evaluation methods (including human-in-the-loop review, benchmarking, and output validation) to evaluate the quality, accuracy, and potential biases of AI-generated outputs.

• Quickly prototype and iterate on AI-driven features, striking a balance between experimentation and production-quality engineering.

• Develop and maintain systems to ensure robust performance while complying with web accessibility standards, security best practices, data privacy regulations, and ethical technology use, particularly in AI applications.

• Produce high-quality, maintainable code, inclusive of documentation, to guarantee code quality across the organization’s systems.

• Offer strategic technical recommendations to leadership, aligning innovative solutions with the organization’s goals.

• Adapt to evolving team priorities and organizational needs, maintaining clear ownership of outcomes and responsibilities.

⛳️ Requirements

• A strong commitment to EdReports’ mission and vision, as well as our core values, and dedication to Diversity, Belonging, Inclusion, and Equity.

• Over 7 years of professional experience in software development or AI systems development; an advanced degree (such as MS or PhD in Computer Science or a related field) may replace up to 2 years of required experience.

• Proven experience in building production systems utilizing LLM APIs, including retrieval-augmented generation (RAG), prompt design, and orchestration frameworks.

• Familiarity with data retrieval systems, search infrastructure, or concepts related to information retrieval.

• Proficiency in scalable, secure web systems, with extensive experience in cloud platforms such as Google Cloud or AWS.

• Experience with automated testing frameworks and CI/CD pipelines.

• A strong product-oriented mindset, having successfully delivered user-centered features in collaboration with product and design teams.

• Excellent communication skills, with a demonstrated ability to articulate complex technical concepts to non-technical stakeholders.

• A Bachelor’s degree in Computer Science, Web Development, or a related field, or equivalent professional experience.

• Residency in and authorization to work in the United States.

🏝️ Benefits

• Unlimited Discretionary Time Off (DTO) and Sick Time,

• 21 days of paid holidays and office closure days in 2026,

• Monthly Communications Reimbursement,

• Initial home office and technology setup stipend,

• EdReports covers 90% of healthcare costs for both the employee and their immediate family,

• 401k plan that new hires become eligible for after six months of employment (includes safe harbor, employer match, etc.).