Senior Collections Data Engineer

This is a fully remote position, open to applicants in California.

📋 Description

• Design and scale high-volume data collection systems that gather threat data from open-web, deep-web, and dark-web sources, including networks like Tor, I2P, and others focused on anonymity.

• Build and maintain resilient, fault-tolerant batch and streaming data pipelines for ingestion, transformation, enrichment, and storage processes.

• Create advanced parsing and normalization logic for unstructured, semi-structured, and quickly evolving threat data formats.

• Design, construct, and sustain agentic workflows utilizing autonomous, LLM-powered agents for multi-step collection and enrichment processes.

• Architect and manage high-scale media pipelines for the ingestion, processing, storage, and enrichment of images, videos, screenshots, documents, and other multimedia.

• Design and develop internal and external APIs to expose collected intelligence to downstream security teams and platforms.

• Write clean, production-quality Python code for data engineering and automation tasks.

• Collaborate with threat intelligence analysts, detection engineers, and security researchers to convert intelligence requirements into dependable, scalable data systems.

• Monitor, troubleshoot, and continuously enhance collection performance, data quality, and latency at scale.

• Stay updated with emerging threat actor tactics, techniques, and procedures (TTPs), data sources, and evasion strategies to enhance collection coverage.

⛳️ Requirements

• 5+ years of experience as a Software Engineer or Data Engineer, emphasizing large-scale data collection and processing.

• Extensive experience in collecting data at scale from open and dark web sources, including scraping, crawling, API integration, Tor-based collection, and anti-detection/anti-bot strategies.

• Strong proficiency in building and operating data pipelines using Airflow, Dagster, Prefect, Spark, Kafka, Flink, or similar technologies.

• Advanced data parsing abilities for converting disorganized, unstructured web data into clean, structured intelligence.

• Expert-level Python skills, including knowledge of async programming, concurrency, and performance optimization.

• Practical experience in designing and implementing agentic workflows with LangChain, CrewAI, AutoGen, LlamaIndex, or similar frameworks, and integrating LLMs into production data systems.

• Proven history of building and maintaining production APIs using FastAPI, Flask, or similar frameworks.

• Strong grasp of cybersecurity concepts and threat intelligence data types, including Indicators of Compromise (IOCs), TTPs, malware samples, phishing kits, and underground forums.

• Comfortable in a fast-paced, ambiguous environment with high-stakes data quality demands.

• Experience with cloud platforms.

• Familiarity with modern data stack tools such as dbt, Snowflake, ClickHouse, and DuckDB.

• Knowledge of containerization, Docker, Kubernetes, and infrastructure-as-code principles.

• Previous work experience in cybersecurity, threat intelligence, or intelligence collection organizations.

• Contributions to open-source tools or public research in the threat intelligence or data collection domains.

• Completion of a Background Check is mandatory for employment at iCOUNTER.

• Must be legally authorized to work in the United States.

🏝️ Benefits

• Comprehensive Health, Dental, & Vision Coverage, with 100% employee premiums paid and 90% dependent premiums covered on base plans.

• 401(k), HSA, & FSA Plans.

• Flexible Paid Time Off (PTO).

• Meaningful equity ownership opportunities.

• Company Holidays & Paid Sick Days.

• Monthly home-office stipend for internet, equipment, or other technology needs.