Experienced Web Scraping Engineer – Python

This is a fully remote position, open to applicants in Poland.

📋 Description

• Create scalable web scrapers

• Establish robust scraping strategies and methods to bypass website restrictions

• Enhance system observability

• Design back-end solutions to address scraping and parsing challenges of varying complexities

• Sustain the existing system and introduce new features related to scraping and parsing

• Tackle intricate challenges while managing infrastructure with over 6PB of Ceph storage, exceeding 60PB of monthly data traffic, handling more than 300k service requests per second, and processing over 500k Kafka messages per second

• Collaborate with a skilled team to develop scrapers for a global scraping and parsing solution

⛳️ Requirements

• Proficient in Python programming

• Solid understanding of computer science principles, including data structures, algorithms, computability, and complexity

• Experience with version control systems, specifically Git

• Familiarity with techniques to bypass website restrictions for scraping

• Capability to employ various scraping methods and utilize open-source tools for scraper development

• Proficient in using Developer Tools

• Knowledge of network protocols, including TLS/SSL

• Experience with browser automation

• Understanding of asynchronous programming concepts

🏝️ Benefits

• Competitive salary

• Flexible working hours

• Opportunity for professional growth and development

• Collaborative and innovative work environment