Software Development Engineer III, CRM - Bulk Import

📋 Description

• Take charge of the entire CRM Bulk Import lifecycle: orchestrating workers, managing the external-import read proxy, creating mapping layers, and integrating with downstream HighLevel services.

• Design and enhance the import pipeline — including Pub/Sub topics, Trigger and Import workers, batch hydration, and ID-mapping in Redis — ensuring accuracy and efficiency.

• Develop and scale stateless proxy services (using NestJS) that interact with third-party CRM REST APIs (currently HubSpot; future integrations include Salesforce, Pipedrive, and Zoho) utilizing Bearer-token authentication, pagination, batch reads, and rate-limit management.

• Address challenges in distributed systems: ensuring idempotent imports, implementing retries, facilitating partial-failure recovery, deduplication, equitable usage across tenants, and managing backoff against upstream rate limits.

• Maintain a CRM-agnostic integration layer: create clean client abstractions, mappers, app-id resolution, and a guard/interceptor seam that remains stable as new CRM solutions are introduced.

• Define the import data contracts — including raw vs mapped response modes, camelCase transformation rules, and exclusion lists — to maintain consistency for worker callers.

• Enhance the performance and reliability of large imports (handling millions of records per run) through batching, paging, parallelism, and intelligent write-side fan-out.

• Deliver end-to-end solutions when required — including UI modifications in Vue (such as import progress indicators, error reporting, and mapping setup) — without delays due to cross-functional dependencies.

• Implement system instrumentation: traceIds, structured logging, metrics, and SLOs that clarify import behavior across bulk actions, external-import, and oauth-api.

• Lead incident response efforts, conduct postmortems, and uphold engineering best practices to ensure the health of a high-traffic, third-party-dependent product.

⛳️ Requirements

• Over 4 years of experience in building and operating production backend systems at scale.

• Strong foundation in distributed systems, asynchronous workers, queue/topic-based architectures, and API design.

• Practical experience with Node.js (preferably NestJS) or Go in a production environment.

• Proven history of owning services from start to finish — encompassing design, build, deployment, and on-call responsibilities.

• Experience in integrating with third-party REST APIs: managing OAuth flows, pagination, rate limits, retries, and error mapping.

• Ability to work independently in ambiguous situations with a strong sense of ownership.

• Comprehensive understanding of scalability, performance, and reliability trade-offs.

🏝️ Benefits

• EEO Statement:

• The company is an Equal Opportunity Employer. As an employer subject to affirmative action regulations, we invite you to voluntarily provide the following demographic information. This information is used solely for compliance with government recordkeeping, reporting, and other legal requirements. Providing this information is voluntary and refusal to do so will not affect your application status. This data will be kept separate from your application and will not be used in the hiring decision.

• We encourage you to review our Privacy Policy before submitting your application.