Senior Scraping Engineer – Web Scraping, Anti-bot

This is a fully remote position, open to applicants in Cyprus.

📋 Description

• Architecture Design

• Data-plane: high-parallel crawler, session management, anti-bot bypass, CAPTCHA solver

• Control-plane: API, authorization, billing, quotas, monitoring

• Infrastructure: microservices, Docker/K8s, CI/CD, observability

• Development Ownership

• Establish development and release processes

• Code quality control and technical decision oversight

• Anti-Bot Research & Bypass

• Browser and network-level fingerprinting (JA3, TLS, CDP)

• Protection bypass: Cloudflare, Akamai, Qrator, ServicePipe, Variti, and others

• DevOps / SRE

• CI/CD setup, Helm charts, scaling configuration

• Monitoring organization (Prometheus, Grafana, Loki) and SLA processes

⛳️ Requirements

• 4-6+ years in backend development, data engineering, automation, or high-load systems.

• Robust experience in production web scraping with protected, dynamic, or JS-heavy websites.

• Proficiency in Python async stack; experience with Go is advantageous.

• Familiarity with Playwright, Puppeteer, Selenium, Scrapy, browser automation, and CDP.

• In-depth knowledge of HTTP, TLS, HTTP/2, cookies, sessions, headers, and proxies.

• Experience with Redis, queues/message brokers, Docker, CI/CD, and observability.

• Kubernetes experience is preferred; extensive K8s/SRE knowledge is a plus but not a strict requirement within this budget.

• Capability to produce clear technical documentation in English.

• Ownership mindset: emphasis on reliability, monitoring, incident debugging, and cost control.

🏝️ Benefits

• Engage in the development of the company's key product from the ground up.

• High level of autonomy and influence on architectural and team decisions.

• Budget allocated for conferences, courses, and work tools.

• Competitive compensation package.

• Flexibility for remote work.