Python Developer

This is a fully remote position, open to applicants in Poland.

📋 Description

• Design, develop, and maintain Python-based scrapers for specific web portals, adeptly managing dynamic content, pagination, rate limiting, and anti-bot measures.

• Integrate scraping pipelines with OCR tools to extract text and structured data from images, scanned documents, and PDFs.

• Construct end-to-end data pipelines that gather, transform, and store scraped data in cloud storage solutions.

• Deploy and oversee scraping tasks on AWS, including scheduling, monitoring, and error management.

• Validate and clean extracted data, address edge cases, and ensure output consistency across different sources.

• Document scraper architecture, data schemas, and operational procedures for effective handover and long-term sustainability.

⛳️ Requirements

• Proficient in Python with extensive experience in web scraping libraries such as Scrapy, BeautifulSoup, Selenium, and Playwright.

• Hands-on experience in integrating OCR tools into data pipelines, including Tesseract or cloud-based OCR services.

• Familiarity with AWS, particularly S3, EC2, and basic networking/scheduling with Lambda, EventBridge, or cron.

• Strong understanding of HTTP, HTML/CSS structure, browser DevTools, and common anti-scraping techniques.

• Experience in data parsing and transformation using JSON, XML, CSV, and libraries like pandas.

• Knowledge of version control with Git and adherence to clean coding practices.

• Comfortable navigating a Linux terminal environment.

• Proficient in English for reading documentation and collaborating with the team.

• Professional experience at an experienced level.

• Nice-to-have: expertise in headless browser automation at scale.

• Nice-to-have: experience with proxy management, CAPTCHA handling, and IP rotation strategies.

• Nice-to-have: familiarity with Docker.

• Nice-to-have: skill in task orchestration tools such as Airflow, Prefect, or Step Functions.

• Nice-to-have: knowledge of SQL databases.

• Nice-to-have: background in the CPG/FMCG or Retail data domain.

🏝️ Benefits

• Fully remote work environment.

• Access to cloud infrastructure (AWS) for development and deployment purposes.

• Collaboration with an experienced Data Science team tackling real business challenges in the CPG/Retail sector.

• Clearly defined project scope and technical support from the team.

• Investment in employee development.

• Equal Opportunity, Affirmative Action employer.