Software Engineer – External Integrations, Data

Posted 3 days ago

This is a fully remote position, open to applicants in Canada.

📋 Description

• Create integrations with external websites, platforms, and services when official APIs are not available, are incomplete, or impose restrictions.

• Develop data collection, extraction, and transformation pipelines from HTML pages, dynamic web applications, documents, and unstructured content.

• Reverse engineer network requests, browser behavior, page layouts, and undocumented interfaces.

• Construct scraping and automation tools utilizing browser automation, HTTP clients, headless browsers, and tailored extraction logic.

• Clean and normalize inconsistent, duplicated, incomplete, or poorly structured data for downstream applications and AI workflows.

• Design robust integrations capable of adapting to changing layouts, evolving systems, rate limits, authentication processes, and failures.

• Utilize LLMs and other AI methodologies to extract, classify, enrich, validate, and structure unstructured data.

• Implement monitoring, retries, validation, error handling, and automated testing to enhance reliability and scalability.

• Partner with engineering and product teams to transform ambiguous requirements and unfamiliar systems into maintainable solutions.


⛳️ Requirements

• Professional software engineering experience in developing production-quality applications, integrations, or data pipelines.

• Background in web scraping or large-scale data extraction, reverse engineering, or working with undocumented interfaces, as well as third-party platforms with insufficient APIs, or transforming and cleaning inconsistent external data.

• Strong expertise in Python, TypeScript, JavaScript, or a similar programming language.

• Familiarity with HTTP, REST principles, HTML, DOM structures, JSON, .NET C#, and making network requests.

• Knowledge of authentication, cookies, sessions, pagination, rate limiting, and challenges associated with external integrations.

• Experience in designing maintainable software that can adapt to changes in external systems.

• Strong debugging and analytical skills for investigating unfamiliar systems and vague technical issues.

• A pragmatic, resourceful mindset with a readiness to experiment, prototype, and devise innovative solutions.


🏝️ Benefits

• Opportunities for professional development and career growth.

• Flexible work hours and remote working options.

• Collaborative and supportive team environment.

• Access to cutting-edge technology and tools.

• Competitive salary and performance-based bonuses.

People also viewed

Helpware8 hours ago

Senior Principal Java Software Engineer

MX flagMexico OnlyFull-timeFull-stack Engineer
ApplyView job
Introhive8 hours ago

Software Engineer Contractor

CA flagCanada OnlyFreelanceFull-stack Engineer
ApplyView job
Boeing8 hours ago

Senior Embedded Software Engineer

US flagUnited States OnlyFull-timeFull-stack Engineer$171.7k – $232.2k/year
ApplyView job
M9 Solutions8 hours ago

HCM Technical Lead

US flagUnited States OnlyFull-timeFull-stack Engineer$225k – $260k/year
ApplyView job
Game Plan Tech8 hours ago

Product Engineer

US flagUnited States OnlyFull-timeFull-stack Engineer
ApplyView job
Airbus8 hours ago

Systems & Software Architect

DE flagGermany OnlyFull-timeFull-stack Engineer
ApplyView job

Never miss a great job!

Get handpicked remote jobs straight to your inbox weekly.

Trusted by 7,400+ designers