Principal Software Architect, Graph

This is a fully remote position, open to applicants in United States.

📋 Description

• Establish and lead the architecture for enterprise-level Identity Resolution platforms and services.

• Create deterministic and probabilistic identity matching systems, entity resolution, identity graphs, record linkage, deduplication, and identity consolidation.

• Develop architectures that resolve identities across extensive, varied, and rapidly evolving datasets.

• Design both real-time and batch solutions for Identity Resolution.

• Formulate strategies for confidence scoring, survivorship, source prioritization, identity linking, and management of the identity lifecycle.

• Design and enhance low-latency, high-throughput, and highly available APIs and services.

• Architect distributed applications and services utilizing Java, Python, and Scala.

• Design high-scale data-processing pipelines and platforms using Apache Spark.

• Design and refine data solutions in Snowflake and Databricks.

• Design efficient data models and SQL-based solutions tailored for transactional, analytical, and Identity Resolution workloads.

• Define strategies for caching, concurrency, partitioning, indexing, persistence, and data access.

• Outline AWS cloud-native architectures and integration methodologies across AWS, Snowflake, Databricks, internal applications, APIs, and external data providers.

• Assess technologies, frameworks, databases, processing engines, and architectural methodologies.

• Set standards and best practices for application architecture, APIs, data architecture, distributed processing, security, observability, testing, and software development.

• Collaborate with engineering teams to translate architectural designs into scalable and maintainable implementations.

• Offer technical guidance and assist in overcoming performance, scalability, and design challenges.

• Conduct architecture and design evaluations.

• Identify performance bottlenecks and guide the optimization of APIs, applications, Spark workloads, SQL queries, and distributed systems.

• Define strategies for resiliency, fault tolerance, high availability, disaster recovery, and operational monitoring.

• Work alongside engineering, data engineering, product, security, infrastructure, and business stakeholders.

• Mentor senior engineers, technical leads, and architects.

• Keep abreast of trends in Identity Resolution, distributed systems, cloud computing, data platforms, and software architecture practices.

⛳️ Requirements

• Over 10 years of professional software engineering experience, with significant involvement in designing complex enterprise software systems.

• Demonstrated experience in roles such as Architect, Principal Engineer, Staff Engineer, or other senior technical leadership positions.

• Extensive experience in designing and implementing Identity Resolution, Entity Resolution, identity graphs, Customer 360, Master Data Management, or related systems.

• Strong proficiency in Java, Python, and Scala.

• In-depth experience with Apache Spark, including architecture, optimization, partitioning, distributed execution, performance tuning, and large-scale processing.

• Advanced SQL proficiency, covering complex queries, relational data modeling, query optimization, and performance tuning.

• Experience in designing REST APIs, microservices, distributed applications, and high-throughput backend services.

• Experience in creating and optimizing low-latency APIs.

• Comprehensive understanding of distributed systems concepts, including concurrency, caching, partitioning, consistency, resiliency, scalability, and fault tolerance.

• Extensive experience with AWS and cloud-native application architecture.

• Strong familiarity with Snowflake and Databricks.

• Experience in designing systems encompassing application, API, distributed processing, data, and cloud infrastructure layers.

• Solid understanding of software engineering principles, design patterns, API design, data structures, algorithms, and application performance.

• Experience with modern CI/CD practices, automated testing, source control, and production software delivery.

• Strong grasp of security, privacy, authentication, authorization, encryption, and data protection practices.

• Bachelor’s degree in Computer Science, Software Engineering, Computer Engineering, or a related technical field, or equivalent professional experience.

• Exceptional analytical, problem-solving, written communication, and verbal communication skills.

• Preferred: experience with graph databases, probabilistic matching, machine learning-based matching, event-driven and streaming architectures, Docker, Kubernetes, Terraform, CloudFormation, multi-region architectures, enterprise architecture standards, legacy modernization, and large-scale identity datasets.

🏝️ Benefits

• Equal opportunity employment statement, including disability and protected veteran status.

• Remote/Homebased work arrangement.