Web Scraping Engineer – Global Team

This is a fully remote position, open to applicants in India.

📋 Description

• Design, develop, and maintain efficient web scrapers that drive essential reports and enhance customer experiences.

• Refine existing scraping scripts to boost reliability, maintainability, and performance.

• Apply clean coding practices, modular design, code reviews, and other industry best practices.

• Utilize fingerprinting techniques such as cookies, headers, user-agent rotation, and proxies to evade detection and blocking.

• Manage dynamic content, intricate DOM structures, and session/cookie lifecycles effectively.

• Work collaboratively with analysts and stakeholders to gather requirements, set targets, and ensure data integrity.

• Offer support, documentation, and best practices for internal stakeholders utilizing web-scraped data.

• Create monitoring solutions and alerting systems to detect and resolve failures.

• Assess scraper performance and troubleshoot bottlenecks and scaling challenges.

• Recommend tools, methodologies, and technologies to enhance scraping capabilities and processes.

• Stay updated on bot-detection strategies and innovative web data extraction methods.

⛳️ Requirements

• Strong communication skills in English with both technical and non-technical audiences.

• Over 3 years of experience working with web scraping frameworks such as Selenium, Playwright, or Puppeteer.

• In-depth understanding of HTTP, RESTful APIs, HTML parsing, browser rendering, and TLS/SSL mechanics.

• Proficient in advanced fingerprinting and evasion techniques, including browser fingerprint spoofing and request signature manipulation.

• Extensive experience managing cookies, headers, session states, and proxy rotations.

• Familiarity with deploying both residential and data center proxies.

• Experience with logging, metrics, and alerting to maintain high availability.

• Strong troubleshooting skills to enhance scraper performance for efficiency, reliability, and scalability.

🏝️ Benefits

• Vacation time

• Parental leave

• Team events

• Learning reimbursement

• Flexible work arrangements, including flexibility around standard 11am–8pm IST work hours

• Opportunities for learning, self-improvement, and skill mastery

• People-centric culture focused on ownership, respect, and trust