Senior Software Engineer – Web Data Team

This is a fully remote position, open to applicants in Washington.

📋 Description

• Design and develop components for scalable, fault-tolerant web crawling and data extraction pipelines.

• Produce clean, production-ready code using Java and Python.

• Create and manage ETL/ELT pipelines for extensive data extraction and transformation.

• Engage with cloud infrastructure on GCP and AWS, with a focus on GKE.

• Enhance observability, reliability, and operational excellence in the systems you support.

• Collaborate with product and data science teams to provide impactful solutions.

• Participate in code reviews, documentation, and knowledge sharing within the team.

• Keep up to date with the latest web technologies, anti-crawling techniques, and AI-driven extraction methods.

⛳️ Requirements

• Over 5 years of professional experience in software engineering, specifically in building production systems.

• Strong foundational knowledge in computer science: algorithms, data structures, concurrency, and distributed systems.

• Expertise in Java and/or Python.

• Proven experience in owning features from design through to deployment and operation.

• Ability to make informed architectural decisions at the component level.

• Practical experience with cloud data warehouses such as BigQuery or Snowflake.

• Experience in designing and managing large-scale ETL/ELT pipelines.

• Familiarity with orchestration tools like Apache Airflow.

• Background in streaming or event-driven systems such as Apache Kafka.

• Production experience on GCP (preferred) or AWS; multi-cloud experience is an added advantage.

• Hands-on experience with Kubernetes (GKE/EKS) for distributed workloads.

• Knowledge of infrastructure-as-code tools like Terraform.

• Strong communication skills to clearly articulate technical decisions.

• Capable of thriving in ambiguous situations and iterating quickly.

• A proactive approach with a focus on practical problem-solving.

• A self-motivated individual who excels in fast-paced, dynamic environments.

🏝️ Benefits

• Health insurance.

• 401(k) matching.

• Flexible work hours.

• Paid time off.

• Remote work options.

• Comprehensive benefits package.

• Holistic programs for mind, body, and lifestyle aimed at overall well-being.