Senior Entity Resolution Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop and enhance entity-level record matching processes: including blocking, candidate generation, pairwise scoring, clustering, and threshold policies.

• Utilize a single matching engine for record linkage, deduplication, and known-entity verification.

• Create provenance so that each node and edge can be traced back to the original source that asserted it.

• Manage the tradeoff between false merges and false splits in matching decisions, ensuring the process is understandable.

• Oversee the technical execution of the matching strategy according to the in-house design, which involves separate evaluations of the fixed reference dataset, candidate retrieval, final matching, and providing threshold recommendations supported by evidence for review.

• Thoroughly document the matching logic to serve as a reference implementation for other engineers.

⛳️ Requirements

• A minimum of 5 years of experience, including delivering production-level record matching or entity resolution.

• Proficiency in articulating the matching tradeoffs made, specifically regarding the management of false merges and false splits.

• Strong skills in Python and SQL, with proven experience handling large, complex real-world data.

• Capability to communicate a matching decision to a stakeholder who must defend it without a deep understanding of the internal workings.

• US Citizenship is required.

• An active US Secret clearance is mandatory to commence work.

• Direct experience applying probabilistic matching techniques to inconsistent identity data such as names, dates, addresses, and identifiers, along with a familiarity with the potential failure modes of each (preferred).

• Familiarity with probabilistic record-linkage frameworks and tools such as Fellegi-Sunter models, Splink, Dedupe, Zingg, or a comparable in-house solution (preferred).

• Experience in record linkage, master data management, or identity management (preferred).

• Experience with graph data modeling and production application of graph algorithms (preferred).

• Proficiency in PostgreSQL and pgvector or a similar technology (preferred).

• An active Top Secret clearance (preferred).

🏝️ Benefits

• A fully remote, results-oriented work environment.

• Competitive salary, bonus, and equity compensation package.

• 100% employer-covered, comprehensive health insurance including medical, dental, and vision for you and your family.

• Unlimited paid time off, contingent on manager approval.

• Flexible work environment where you can manage your own workday.

• 14 weeks of fully paid parental leave.