Senior Data Engineer – Cybersecurity

This is a fully remote position, open to applicants in Illinois.

📋 Description

• Create, develop, and sustain efficient data pipelines utilizing GCP native services.

• Establish and oversee data quality frameworks to guarantee the integrity and dependability of security data assets.

• Integrate various data sources and security tools through APIs to consolidate security monitoring.

• Enhance database performance, optimize query efficiency, and manage storage costs within Google BigQuery.

• Leverage Cribl to route, shape, and enrich incoming security telemetry and log data (preferred).

• Design, implement, and track automated ETL/ELT data pipelines using Python, SQL, and GCP services such as Cloud Functions, Cloud Scheduler, and Dataflow.

• Oversee and refine BigQuery schema designs, partitioning, and clustering for cost-effective, high-performance querying.

• Execute and scale data quality and auditing frameworks using GCP Dataplex with centralized rules metadata configuration.

• Create and sustain API integrations with EAMS, TrendMicro, and other threat detection platforms to collect essential security logs.

• Set up and manage Cribl Stream pipelines to parse, mask, enrich, and route security logs (preferred).

• Implement Cribl log reduction techniques to optimize data ingestion and decrease downstream storage costs (preferred).

• Collaborate with security teams to provide actionable data products, reporting views, and tactical dashboards to avert service disruptions.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Computer Engineering, Data Science, Information Technology, or a related technical field (or equivalent combination of education and experience).

• Over 8 years of professional experience in Data Engineering, Cloud Data Warehousing, or software development.

• More than 5 years of practical experience in designing and implementing production-grade solutions on Google Cloud Platform (GCP).

• Familiarity with Google BigQuery, Cloud Run/Functions, Cloud Storage, Dataflow, and PubSub.

• High proficiency in Python programming.

• Advanced SQL skills for constructing, optimizing, and troubleshooting intricate ETL/ELT pipelines.

• Exceptional written and verbal communication abilities.

• Capability to collaborate effectively with cross-functional teams in an agile setting.

• Candidates must be legally authorized to work in the United States.

• Visa sponsorship is not available.

🏝️ Benefits

• Immediate medical, dental, vision, and prescription drug coverage.

• Flexible family care days.

• Paid parental leave.

• New parent ramp-up programs.

• Subsidized back-up child care.

• Family building benefits, including reimbursement for adoption and surrogacy expenses as well as fertility treatments.

• Vehicle discount program for employees and family members, along with management leases.

• Tuition assistance.

• Established and active employee resource groups.

• Paid time off for individual and team community service.

• Generous schedule of paid holidays, including the week between Christmas and New Year’s Day.

• Paid time off.

• Option to purchase additional vacation time.