Web Scraping Engineer, Python

This is a fully remote position, open to applicants in Poland.

📋 Description

• Create scalable web scrapers.

• Establish robust scraping strategies and find ways to bypass website restrictions for scraping.

• Enhance system observability.

• Develop backend solutions to address scraping and parsing challenges of varying complexities.

• Support the existing system and introduce new features related to scraping and parsing.

⛳️ Requirements

• Proficient in Python programming.

• Solid understanding of computer science principles, including data structures, algorithms, computability, and complexity.

• Experience with version control systems, particularly Git.

• Familiarity with methods to bypass website restrictions for scraping.

• Ability to utilize various scraping techniques and open-source tools for developing scrapers.

• Comfortable using Developer Tools.

• Knowledge of networking concepts (TLS/SSL).

• Experience with browser automation.

• Proficient in asynchronous programming.

• Nice to have:

• Understanding of web development.

• Familiarity with CSS Selectors and XPaths for parsing.

• Experience with Go and C++ programming languages.

• Background in working with browser source code.

• Knowledge of any front-end frameworks.

• Experience with Pydantic, FastAPI, and SQLAlchemy.

• Familiarity with technologies such as Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana, and monitoring tools like Grafana and Prometheus.

• Experience with machine learning applications in the scraping domain.

• Proven experience in building scalable systems.

🏝️ Benefits

• Competitive salary and performance-based incentives.

• Opportunities for professional development and growth.

• Flexible working hours and remote work options.

• Comprehensive health and wellness benefits.

• Collaborative and inclusive work environment.