Senior Data Engineer

This is a fully remote position, open to applicants in India.

📋 Description

• Collaborate with the CDP team to define event schemas, necessary fields, and compatibility rules.

• Implement automated validation and enforce contracts to prevent disruptive schema changes.

• Maintain versioning and compatibility assurances for event producers and downstream consumers.

• Develop and sustain pipelines that ingest, validate, and process high-volume product events.

• Ensure that event streams are deduplicated, sequenced accurately, and safe for downstream use.

• Collaborate with platform teams to ensure that ingestion pipelines can scale with product expansion.

• Establish and uphold identity stitching logic across both anonymous and authenticated users.

• Manage identity merges, splits, and corrections while upholding tenant boundaries.

• Guarantee that identity resolution is explainable, deterministic, and safe for downstream datasets.

• Design workflows that enable event datasets and identity graphs to be safely replayed or rebuilt.

• Create tools for historical corrections, schema evolution, and dataset reprocessing.

• Ensure that downstream models can be rebuilt automatically when definitions change.

• Provide guidance and tools to assist product teams in emitting events consistently.

• Maintain validation checks and schema enforcement to identify instrumentation issues early.

• Work collaboratively with engineering teams to safely evolve instrumentation over time.

• Ensure that deletion and suppression requests are correctly propagated through event and identity pipelines.

• Collaborate with governance and security teams to meet policy requirements.

• Define requirements and interfaces for event infrastructure and downstream analytical systems.

• Partner with platform teams to maintain the reliability, scalability, and observability of pipelines.

⛳️ Requirements

• 4+ years of experience in data engineering, platform engineering, or product data positions.

• Strong experience in building and operating event ingestion or streaming pipelines.

• Experience in implementing schema validation, data contracts, or event governance frameworks.

• Proficient in SQL and Python, with a background in developing data processing or validation tools.

• Familiarity with identity resolution, entity resolution, or customer identity systems.

• Experience in operating analytical data systems or managing large-scale event datasets.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Flexible work hours and remote work options.

• Opportunities for professional development and continuous learning.