
Software Engineer – External Integrations, Data
Posted 3 days ago

Posted 3 days ago
This is a fully remote position, open to applicants in Canada.
• Create integrations with external websites, platforms, and services when official APIs are not available, are incomplete, or impose restrictions.
• Develop data collection, extraction, and transformation pipelines from HTML pages, dynamic web applications, documents, and unstructured content.
• Reverse engineer network requests, browser behavior, page layouts, and undocumented interfaces.
• Construct scraping and automation tools utilizing browser automation, HTTP clients, headless browsers, and tailored extraction logic.
• Clean and normalize inconsistent, duplicated, incomplete, or poorly structured data for downstream applications and AI workflows.
• Design robust integrations capable of adapting to changing layouts, evolving systems, rate limits, authentication processes, and failures.
• Utilize LLMs and other AI methodologies to extract, classify, enrich, validate, and structure unstructured data.
• Implement monitoring, retries, validation, error handling, and automated testing to enhance reliability and scalability.
• Partner with engineering and product teams to transform ambiguous requirements and unfamiliar systems into maintainable solutions.
• Professional software engineering experience in developing production-quality applications, integrations, or data pipelines.
• Background in web scraping or large-scale data extraction, reverse engineering, or working with undocumented interfaces, as well as third-party platforms with insufficient APIs, or transforming and cleaning inconsistent external data.
• Strong expertise in Python, TypeScript, JavaScript, or a similar programming language.
• Familiarity with HTTP, REST principles, HTML, DOM structures, JSON, .NET C#, and making network requests.
• Knowledge of authentication, cookies, sessions, pagination, rate limiting, and challenges associated with external integrations.
• Experience in designing maintainable software that can adapt to changes in external systems.
• Strong debugging and analytical skills for investigating unfamiliar systems and vague technical issues.
• A pragmatic, resourceful mindset with a readiness to experiment, prototype, and devise innovative solutions.
• Opportunities for professional development and career growth.
• Flexible work hours and remote working options.
• Collaborative and supportive team environment.
• Access to cutting-edge technology and tools.
• Competitive salary and performance-based bonuses.
Helpware
Introhive
Boeing
M9 Solutions
Get handpicked remote jobs straight to your inbox weekly.