Senior Python Data Scraping Engineer

This is a fully remote position, open to applicants in Sweden, +5 more countries.

📋 Description

• Manage complete data extraction processes across intricate websites, ensuring thorough coverage, precision, and dependable delivery of structured datasets.

• Utilize existing tools and tailored workflows to expedite data collection, validation, and task execution while adhering to established requirements.

• Guarantee dependable extraction from dynamic and interactive web sources, modifying strategies for JavaScript-rendered content and evolving site behaviors.

• Uphold data quality standards through validation checks, consistency controls across sources, formatting guidelines, and systematic verification before delivery.

• Enhance scraping operations for large datasets by employing efficient batching or parallel processes, monitoring failures, and ensuring stability against minor structural changes on sites.

• Leverage expertise in web scraping, data extraction, and data processing for the Tendem project.

• Employ technologies such as Apify, OpenRouter, and other tools in conjunction with technical knowledge and customized approaches.

⛳️ Requirements

• Minimum of 5+ years of relevant experience in data engineering, web scraping, automation, or software development (mandatory).

• A Bachelor’s or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is advantageous.

• Extensive experience in Python web scraping (using BeautifulSoup, Selenium, or similar), including dynamic content (JavaScript, AJAX, infinite scrolling) and APIs via proxies.

• Demonstrated ability to extract data from complex frameworks (hierarchies, archived pages, inconsistent HTML).

• Strong background in data cleaning, normalization, and validation, producing structured datasets (CSV, JSON, Google Sheets).

• Proven experience in managing anti-bot mechanisms and dynamic site architectures at scale.

• Familiarity with cloud infrastructure (AWS or similar) and containerization (Docker) within real workflows.

• Practical experience with LLM frameworks (such as LangChain, OpenRouter, or comparable) applied to automation tasks.

• Keen attention to detail and a strong commitment to data accuracy.

• Autonomous work ethic with the capability to troubleshoot independently.

• A link to GitHub is considered a plus.

• Proficiency in English: upper-intermediate (B2) or above (required).

🏝️ Benefits

• Opportunity for part-time remote work.

• Freelance position.

• Flexible estimated workload of approximately 10–20 hours per week during active phases.