Senior AI Data Engineer

This is a fully remote position, open to applicants in Peru, +3 more countries.

📋 Description

• Develop and enhance the foundational platform for entity management and governance, focusing on entity types, attributes, cross-references (XREFs), and their interrelations.

• Construct and refine Named Entity Recognition (NER) pipelines for various text and file formats by integrating LLM-based models, gazetteers, pattern recognition, and blacklists.

• Expand NER functionalities to accommodate new content formats, including live-stream data.

• Enhance search capabilities and entity discovery through entity resolution, personalized search features, filtering options, and relationship navigation.

• Design and query graph-based relationship frameworks to facilitate traversal, visualization, and connected business insights.

• Implement security and access controls at the entity level for data retrieval and exploration purposes.

• Integrate new data sources and provide support for applications that consume this data.

• Convert business needs into technical solutions and AI workflows while critically assessing AI-generated code and designs.

• Collaborate with stakeholders across various business sectors to define and prioritize the platform roadmap.

• Assist in team onboarding and promote knowledge sharing initiatives.

⛳️ Requirements

• Over 7 years of experience in software engineering, specifically in building or managing data-intensive platforms in a production environment.

• Familiarity with search platforms like Elasticsearch or OpenSearch, as well as information retrieval and entity resolution techniques.

• Understanding of graph databases and knowledge graphs, such as Neo4j and Cypher.

• Hands-on experience with NLP and NER, including LLM-based extraction and open-source models like Gemma, Llama, GLiNER, or spaCy.

• Proficiency in PostgreSQL, Kubernetes, and monitoring tools such as Datadog.

• Experience with data ingestion and synchronization across multiple source systems.

• Strong skills in systems thinking, architecture, and data modeling, especially in complex business domains.

• Practical experience with AI-assisted development tools such as GitHub Copilot, Cursor, Claude, ChatGPT, and agentic workflows.

• Ability to critically assess, validate, and adjust AI-generated outputs using sound engineering principles.

• Exceptional communication abilities.

• Knowledge of permission-aware data access and security filtering mechanisms.

• Proficient in at least one programming language, such as Python, Java, or another relevant language.

🏝️ Benefits

• Equal opportunity employer dedicated to creating an inclusive work environment.

• All qualified candidates will be considered without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.