
Senior AI Data Engineer
Posted 4 days ago

Posted 4 days ago
This is a fully remote position, open to applicants in Colombia, +3 more countries.
• Develop and enhance the fundamental platform for entity management and governance, encompassing entity types, attributes, cross-references (XREFs), and relationships.
• Construct and refine Named Entity Recognition (NER) pipelines for text and files by integrating LLM-based models, gazetteers, pattern matching, and blacklists.
• Expand NER functionalities to accommodate new content types, including live-stream content.
• Enhance search and entity discovery through entity resolution, personalized search, filtering, and relationship navigation.
• Design and query graph-based relationship models to facilitate traversal, visualization, and connected business context.
• Implement entity-level security and access controls across data retrieval and exploration.
• Integrate new data sources and support connections with consuming applications.
• Convert business requirements into technical solutions and AI workflows, rigorously validating AI-generated code and designs.
• Collaborate with stakeholders across various business domains to shape and prioritize the platform roadmap.
• Facilitate team onboarding and knowledge sharing.
• Over 7 years of software engineering experience, including the development or management of data-intensive platforms in production.
• Proficiency with search platforms such as Elasticsearch or OpenSearch, as well as experience in information retrieval and entity resolution.
• Familiarity with graph databases and knowledge graphs, such as Neo4j and Cypher.
• Applied experience in NLP and NER, including LLM-based extraction and open-source models like Gemma, Llama, GLiNER, or spaCy.
• Experience with PostgreSQL, Kubernetes, and observability tools such as Datadog.
• Expertise in data ingestion and synchronization from multiple source systems.
• Strong systems thinking, architecture, and data modeling abilities, with experience in modeling complex business domains.
• Practical experience with AI-assisted development tools such as GitHub Copilot, Cursor, Claude, ChatGPT, and agentic workflows.
• Capability to critically assess, validate, and amend AI-generated outputs using sound engineering judgment.
• Excellent communication skills.
• Knowledge of permission-aware data access and security filtering.
• Proficiency in at least one programming language, such as Python, Java, or another language.
• Experience in the Oil & Gas sector or other asset-heavy industries is preferred.
• Equal opportunity employer committed to fostering an inclusive workplace.
Instacart
GEICO
Litmus
Candid
Get handpicked remote jobs straight to your inbox weekly.