Scraping Engineer – Web scraping, Anti-bot

This is a fully remote position, open to applicants in Spain.

📋 Description

• Architecture Design: Data-plane: high-throughput crawler, session management, anti-bot evasion, CAPTCHA resolution

• Control-plane: API management, authorization processes, billing systems, quotas, and monitoring

• Infrastructure: microservices architecture, Docker/Kubernetes, continuous integration and deployment, observability

• Development Ownership: Define development and release workflows, ensure code quality, and oversee technical decisions

• Anti-Bot Research & Bypass: Browser and network-level fingerprinting techniques (JA3, TLS, CDP), evasion strategies for Cloudflare, Akamai, Qrator, ServicePipe, Variti, and others

• DevOps / SRE: Set up CI/CD pipelines, create Helm charts, configure scaling, organize monitoring (using Prometheus, Grafana, Loki) and establish SLA processes

⛳️ Requirements

• Over 5 years of engineering experience in high-load backend/data platforms

• Significant experience in scraping (mandatory)

• Strong understanding of **HTTP, TLS, HTTP/2, proxies, and browser stack (CDP, WebRTC)**

• Proficient in async **Python** and **Go** (preferably both), **Redis, queues, and message brokers**

• Advanced knowledge of DevOps tools: **Kubernetes, Helm, Prometheus, and CI/CD**

• Experience in analyzing and circumventing bot protection systems — a strong advantage

• **Fluent English** (all documentation and team communication are conducted in English)

• Strong decision-making capabilities, mentoring skills, and accountability for outcomes

🏝️ Benefits

• Engage in the development of the company's flagship product from the ground up

• High degree of autonomy and influence over architectural and team decisions

• Budget allocated for conferences, courses, and essential work tools

• Competitive compensation package

• Flexibility for remote work