Staff Software Engineer – Data Acquisition

This is a fully remote position, open to applicants in California, +5 more states.

📋 Description

• Develop and sustain high-performance data acquisition pipelines that integrate systems between WEX and external vendors.

• Spearhead the design and implementation of a modular ingestion platform featuring reusable connectors and configuration-driven onboarding processes.

• Create metadata and configuration patterns to minimize source-specific development, facilitating Data Acquisition as a Service.

• Incorporate schema validation, completeness checks, reconciliation, duplicate prevention, and audit logging into shared ingestion components.

• Support safe retries, replays, backfills, and schema evolution.

• Design batch, CDC, and streaming ingestion patterns that satisfy freshness, throughput, and recovery requirements.

• Assess performance, impact on source systems, and operating costs when choosing and expanding ingestion technologies.

• Ensure traceability, lineage, and security by integrating with control plane and governance systems.

• Lead design and code review sessions.

• Maintain technical specifications and architectural documentation.

• Mentor engineers on reusable platform design.

• Implement automated testing and CI/CD practices for ingestion code, connector configuration, and infrastructure.

• Collaborate with production support on complex escalations, root-cause analysis, and preventive engineering enhancements.

• Define baselines and outcomes with engineering and product leadership, aimed at reducing onboarding effort, enhancing reusable capability adoption, improving data completeness and freshness, and decreasing deployment failures.

⛳️ Requirements

• Bachelor's degree in Computer Science, Engineering, or a related technical field.

• Over 8 years of software engineering experience.

• Proven experience in delivering production-grade distributed systems or data platforms.

• Demonstrated technical leadership across team boundaries.

• Strong programming proficiency in Python, Java, Scala, or another systems-oriented language.

• Experience in data integration and ingestion pipelines.

• Solid foundation in engineering principles, including version control, modular design, testing, and performance optimization.

• Experience in designing and managing production integrations that accommodate schema evolution, failure recovery, observability, and secure access.

• Ability to lead architectural decisions, elucidate engineering trade-offs, resolve cross-team dependencies, and guide implementation through production adoption.

• Practical experience with AI-assisted engineering tools for design, coding, testing, or documentation.

• Validation of AI-generated outputs for accuracy, security, and maintainability.

• A collaborative approach across various domains, products, and infrastructure levels.

• Strong sense of ownership and accountability.

• Candidates must reside within 30 miles of Portland, ME; Boston, MA; Chicago, IL; Dallas, TX; San Francisco Bay Area, CA; or Seattle, WA.

• A Master's degree in a related field is advantageous but not mandatory.

• Preferred experience includes building reusable connectors, metadata-driven ingestion services, or configuration-driven onboarding capabilities.

🏝️ Benefits

• Health, dental, and vision insurance.

• Retirement savings plan.

• Paid time off.

• Health savings account.

• Flexible spending accounts.

• Life insurance.

• Disability insurance.

• Tuition reimbursement.

• Eligibility for quarterly or annual bonuses for non-sales roles.