Senior Software Engineer – Identity Resolution

This is a fully remote position, open to applicants in United States.

📋 Description

• Design, develop, test, and maintain software that supports extensive Identity Resolution and Entity Resolution platforms.

• Create systems that match, link, consolidate, and resolve identities across various datasets and data sources.

• Implement both real-time and batch identity-resolution workflows.

• Develop high-performance backend services and APIs utilizing Java, Python, and Scala.

• Construct and enhance low-latency APIs that facilitate real-time identity lookup and resolution.

• Create large-scale distributed data-processing applications using Apache Spark.

• Build and manage Spark workloads leveraging Scala and Python.

• Develop intricate SQL queries and data-processing logic for identity matching, analysis, and data transformation.

• Optimize and operate large-scale data-processing workloads with Databricks.

• Craft cloud-native applications and data-processing solutions on AWS.

• Translate solution designs and technical specifications into production-quality software in collaboration with architects.

• Engage in technical design discussions and propose implementation strategies.

• Implement both deterministic and probabilistic matching logic, fuzzy matching, data normalization, identity linking, and related functionalities.

• Enhance application code, Spark workloads, SQL queries, and data pipelines.

• Diagnose application, distributed-processing, data-quality, and production performance challenges.

• Develop automated tests and validation methodologies for ensuring identity-matching accuracy and reliability.

• Integrate monitoring, logging, metrics, and observability into production applications and data-processing workloads.

• Take part in code reviews and establish robust software engineering practices.

• Mentor junior and mid-level engineers, providing technical mentorship.

• Collaborate with architects, engineering teams, data specialists, product managers, security personnel, and other stakeholders.

• Stay updated with the latest technologies and practices pertinent to Identity Resolution, distributed systems, cloud computing, and large-scale data processing.

⛳️ Requirements

• Over 5 years of professional software development experience, including the design and support of production software systems.

• Strong expertise in Java and enterprise application development.

• Proficient in Python for application development, data processing, automation, or distributed workloads.

• Strong capability in Scala, especially in the context of large-scale data-processing applications.

• Extensive hands-on experience with Apache Spark and distributed data processing.

• Advanced skills in SQL, including complex queries, data transformations, and optimization techniques.

• Experience in developing production workloads with Databricks.

• Proven ability to build cloud-based applications and services using AWS.

• Familiarity with Identity Resolution, Entity Resolution, record linkage, data matching, or similar large-scale data-processing systems.

• Experience creating REST APIs, backend services, microservices, or distributed applications.

• Proven track record in building and optimizing high-throughput, low-latency services and APIs.

• Strong grasp of distributed systems concepts, including concurrency, partitioning, caching, resiliency, scalability, and fault tolerance.

• Experience in optimizing Spark workloads, covering aspects such as partitioning, joins, caching, memory utilization, and execution performance.

• Comprehensive understanding of software engineering principles, object-oriented design, data structures, algorithms, and design patterns.

• Familiarity with automated testing, CI/CD practices, source control, and contemporary software delivery methodologies.

• Proficient with Git and collaborative software development workflows.

• Strong analytical, troubleshooting, and problem-solving abilities.

• Exceptional written and verbal communication skills.

• Capability to independently manage complex development tasks while effectively collaborating with architects and other engineering team members.

• Bachelor’s degree in Computer Science, Software Engineering, Computer Engineering, or a related technical discipline, or equivalent professional experience.

• Experience or strong familiarity with Identity Resolution, Entity Resolution, Customer 360, Master Data Management, identity graph, record linkage, or comparable matching systems.

🏝️ Benefits

• Equal opportunity employment, including protection for individuals with disabilities and veterans.

• Applications for remote positions may be considered for candidates residing in Colorado, California, Connecticut, Massachusetts, Maryland, Nevada, New Jersey, New York City, Ohio, Rhode Island, Virginia, and Washington.