Senior Scraping Engineer – Web Scraping, Anti-bot

This is a fully remote position, open to applicants in Serbia.

📋 Description

• Design architecture for high-parallel crawlers, session management, and anti-bot bypass, including CAPTCHA solvers.

• Develop control-plane components such as APIs, authorization mechanisms, billing systems, quotas, and monitoring tools.

• Build infrastructure utilizing microservices, Docker/Kubernetes, CI/CD practices, and observability techniques.

• Implement development and release processes.

• Oversee code quality control and guide technical decision-making.

• Conduct anti-bot research and develop bypass strategies including browser and network-level fingerprinting (JA3, TLS, CDP).

• Work on protection bypass techniques for platforms like Cloudflare, Akamai, Qrator, ServicePipe, Variti, and others.

• Set up CI/CD pipelines, Helm charts, and scaling configurations.

• Organize monitoring solutions using Prometheus, Grafana, and Loki, as well as manage SLA processes.

⛳️ Requirements

• 4-6+ years of experience in backend development, data engineering, automation, or high-load systems.

• Proven experience with web scraping in production environments, particularly with protected, dynamic, or JavaScript-heavy websites.

• Proficiency in Python's async stack; experience with Go is advantageous.

• Familiarity with tools like Playwright, Puppeteer, Selenium, Scrapy, browser automation, and CDP.

• Solid understanding of HTTP, TLS, HTTP/2, cookies, sessions, headers, and proxies.

• Knowledge of Redis, message queues/brokers, Docker, CI/CD, and observability practices.

• Experience with Kubernetes is preferred; deep knowledge of K8s/SRE is a plus but not a mandatory requirement for this budget.

• Capability to produce clear technical documentation in English.

• An ownership mindset focusing on reliability, monitoring, incident debugging, and cost management.

🏝️ Benefits

• Engage in the development of the company's primary product from the ground up.

• Enjoy high levels of autonomy and the opportunity to influence architectural and team decisions.

• Access to a budget for conferences, training courses, and essential work tools.

• Receive a competitive compensation package.

• Benefit from remote work flexibility.