This is a fully remote position, open to applicants in United States.

📋 Description

• Design and oversee version-controlled data pipelines that facilitate the ingestion and integration of intricate retail data.

• Ensure that the data outputs presented on consumer-facing dashboards achieve a high standard for accuracy and dependability.

• Adopt a "right tool for the job" methodology—developing robust rules-based normalization and RegEx logic for specific tasks, while strategically incorporating LLMs.

• Create architectural solutions that consider the vast scale of retail environments.

• Oversee the lifecycle of data schema and pipeline logic to enable rapid iteration without disrupting downstream consumer insights.

⛳️ Requirements

• Significant experience in developing reliable, staged pipelines for complex ingestion processes.

• Proven track record of merging diverse, unstructured data sources into a cohesive "Golden Record."

• Proficient with LLMs and prompt engineering, yet discerning enough to recognize when simpler regex or bounded heuristics are the superior engineering solutions.

• Strong belief in versioning all elements—from your code to your data schemas.