Senior Python Data Scraping Engineer

This is a fully remote position, open to applicants in Serbia, +5 more countries.

📋 Description

• Manage comprehensive data extraction processes across intricate websites.

• Guarantee thorough coverage, precision, and dependable delivery of structured datasets.

• Utilize tools and personalized workflows to enhance data collection, validation, and task execution.

• Consistently extract data from dynamic and interactive web sources, including content rendered via JavaScript.

• Modify scraping techniques to adapt to evolving site behaviors.

• Uphold data quality through validation checks, cross-source consistency controls, formatting adherence, and systematic verification.

• Expand scraping operations for extensive datasets using effective batching or parallel processing.

• Supervise failures and ensure stability against minor alterations in site structure.

• Implement Python, Apify, OpenRouter, and other technologies in web extraction and processing workflows.

⛳️ Requirements

• Minimum of 5+ years of relevant experience in data engineering, web scraping, automation, or software development.

• Bachelor’s or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or related technical disciplines is advantageous.

• Solid technical foundation and hands-on experience with scripting, automation, and data extraction workflows.

• Proven experience in addressing complex problems and utilizing contemporary development tools and technologies.

• Experience in systematically gathering, organizing, and validating data from various sources.

• Strong expertise in Python web scraping, including BeautifulSoup, Selenium, or similar technologies, as well as dynamic content (JS, AJAX, infinite scroll) and API interactions via proxies.

• Capability to extract data from intricate structures, including hierarchies, archived pages, and inconsistent HTML.

• Proficiency in data cleaning, normalization, and validation, delivering structured datasets in formats such as CSV, JSON, and Google Sheets.

• Familiarity with tackling anti-bot measures and navigating dynamic site architectures at scale.

• Experience with cloud infrastructure like AWS or its equivalent and containerization using Docker.

• Practical experience with LLM frameworks such as LangChain, OpenRouter, or similar, applied to automation tasks.

• Strong attention to detail and a commitment to data accuracy.

• Self-motivated work ethic and the ability to troubleshoot independently.

• Proficiency in English: Upper-intermediate (B2) or higher.

• A link to GitHub is an advantage.

🏝️ Benefits

• Freelance, part-time remote position.

• Estimated 10–20 hours per week during active project phases.

• Compensation of up to $45 per hour equivalent, based on level and pace of contribution.