Staff Parser/Compiler Research Engineer

This is a fully remote position, open to applicants in New York.

📋 Description

• Create and implement high-performance parsers and data structures that integrate with LLMs.

• Investigate advanced technologies related to parsers, compilers, and symbolic methods.

• Maintain reliability and efficiency through thorough testing and optimization processes.

• Stay updated on the latest advancements in LLM technologies.

• Transform JSON Schema, regex, grammars, function definitions, and policies into token-decision logic for application within decoding loops.

• Support the development of reliable and secure agents by facilitating constrained generation.

⛳️ Requirements

• Extensive knowledge of Python at a professional level.

• Hands-on experience with lower-level programming languages such as C/C++ or Rust.

• Direct involvement with parsers like Earley or LALR(1).

• Familiarity with formal grammar structures.

• Experience with finite-state machines.

• Proven background in implementing efficient data structures.

• Capability to conduct research and development in the fields of parsers, compilers, and symbolic methods.

• Awareness of relevant technical reports and open-source projects.

• Ability to showcase simplicity, testing, and automation in work.

• Clear, concise, and consistent written communication skills.

• A one-page resume submitted in English.

• Availability for at least 3 hours daily overlapping with New York City Eastern Time business hours from 8am to 1pm.

🏝️ Benefits

• Stock options.

• Health and dental insurance.

• 401(k) plan available for US employees.

• GPU access provided if necessary.

• Fully remote work environment.

• Opportunities for organic discussions instead of frequent large team meetings.