Web Scraping Developer

This is a fully remote position, open to applicants in Malta.

📋 Description

• Design, develop, and sustain web scraping and automation solutions.

• Create integrations with websites, APIs, email platforms, spreadsheets, and additional third-party systems.

• Extract, transform, and load (ETL) data into the company's data repository.

• Oversee and maintain the current scraping infrastructure to ensure its reliability and scalability.

• Analyze, troubleshoot, and adapt to modifications in target systems and anti-bot mechanisms.

• Work collaboratively with internal teams to establish data collection requirements and enhance data pipelines.

⛳️ Requirements

• Strong expertise in Python.

• Familiarity with UV for managing Python dependencies and environments.

• Daily development experience in Linux environments.

• Extensive knowledge of PostgreSQL.

• Proficient in using Docker.

• Experience with AWS services.

• Competent with Git, especially GitHub.

• Practical experience with browser automation frameworks, such as Selenium.

• Experience utilizing HTTP clients, for example, requests.

• Strong comprehension of CSS Selectors and XPath, proxy rotation and management, JavaScript injection and DOM manipulation, browser fingerprint spoofing and rotation, and scraping dynamic and JavaScript-heavy websites.

• Experience in circumventing anti-bot and anti-scraping systems, with knowledge of advanced browser evasion techniques and detection avoidance strategies (Nice to Have).

🏝️ Benefits

• Ownership & Impact: You will contribute to shaping the architecture, scalability, and long-term vision of an expanding digital platform in competitive sectors.

• Flexibility: Enjoy a remote working environment, or join us at our office located in Malta.

• Competitive Compensation: We provide attractive compensation packages, along with opportunities for performance-based incentives.