Data Engineer – Engineering & Operations

This is a fully remote position, open to applicants in New York.

📋 Description

• Create, develop, and maintain scalable data pipelines, clean room environments, identity workflows, and privacy-compliant data integrations to enhance NBCUniversal’s data collaboration framework.

• Assist in onboarding partners into clean room environments across various platforms.

• Set up and oversee clean room environments, which includes managing data access, environment configuration, platform setup, and validation of releases.

• Apply privacy-preserving measures such as aggregation thresholds, anonymization techniques, approved query patterns, and validation checks on outputs.

• Deploy and manage Python-based libraries, templates, and reusable components within the clean room and data platform landscape.

• Design, implement, and uphold detailed role-based access control policies throughout data platform environments.

• Construct, develop, and manage scalable ELT pipelines utilizing advanced SQL, Snowpark, PySpark, dbt, or comparable technologies.

• Develop and refine identity resolution logic that aligns internal NBCU data with third-party identifiers.

⛳️ Requirements

• Bachelor’s degree or equivalent hands-on experience in Computer Science, Information Systems, Software Engineering, Electrical Engineering, Electronics Engineering, Data Engineering, or a relevant technical discipline.

• Over 3 years of experience in data engineering, encompassing the development and operation of production data pipelines, data models, and data products.

• Strong expertise in advanced SQL and Python for data processing, automation, pipeline development, validation, and operational support.

• More than 2 years of practical experience with cloud data platforms such as Snowflake, Databricks, or similar technologies.

• Proven experience in creating scalable ELT pipelines using tools like Airflow, dbt, Snowpark, PySpark, or similar technologies.

🏝️ Benefits

• Medical, dental, and vision insurance.

• 401(k) plan.

• Paid leave.

• Tuition reimbursement.

• A range of additional discounts and perks.