Data Engineer – AI, Agents, Context, Clinical – Senior Associate

This is a fully remote position, open to applicants in Illinois.

📋 Description

• Develop and enhance the AI context platform.

• Create end-to-end pipelines encompassing: ingestion → parsing/chunking → enrichment → embeddings → vector indexing → retrieval/serving.

• Establish and uphold patterns for incremental refresh, backfills, re-embeddings, deduplication, and lineage across unstructured data sources.

• Collaborate with AI engineers to enhance retrieval quality through query strategies, hybrid search, and metadata filtering.

• Provide semantic and governed data products.

• Implement semantic layers (metrics/entities) that consistently support BI and agent reasoning.

• Ensure that datasets and indexes are well-documented and reusable.

• Maintain reliability and performance across assigned workstreams, including monitoring, alerting, runbooks, and incident response.

⛳️ Requirements

• A BA or BS is required, preferably in Computer Science, Engineering, or a technology-oriented field.

• 3–6 years of experience in data engineering or data platform roles with a strong focus on hands-on delivery.

• Proficiency in SQL and Python (or Scala/Java) with solid production engineering practices.

• Proven experience in designing and managing cloud data pipelines at scale.

• Knowledge of unstructured data processing and search/retrieval concepts.

🏝️ Benefits

• Medical, dental, and vision insurance.

• 401(k) plan with a generous employer match.

• Employee stock purchase plan.

• Generous Paid Time Off policy.

• Paid parental leave and adoption assistance.

• Wellness Program that supports overall well-being.