Staff Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Take ownership and lead significant initiatives within Data Platform Engineering.

• Architect data solutions that cater to batch, streaming, and real-time workloads.

• Develop and construct dependable data pipelines utilizing Spark, Kafka, Iceberg, and Airflow/MWAA.

• Advance the data lake and data platform concerning ingestion, processing, storage, and serving.

• Create, manage, and scale cloud data infrastructure, including Kafka, Airflow, Druid, and EMR on EKS.

• Enhance data quality, observability, reliability, and governance across pipelines and systems.

• Establish standards for event instrumentation and governance, covering schemas, validation, and schema evolution.

• Develop platform solutions for handling PII, data retention, deletion, and residency in compliance with GDPR and CCPA.

• Construct agent harness capabilities that integrate data engineering standards, pipeline patterns, and quality gates into AI tools and workflows.

• Diagnose production challenges and actively contribute to intricate technical projects.

• Mentor engineers and work collaboratively with Analytics Engineering and other departments.

• Report directly to the Manager of Data Engineering.

⛳️ Requirements

• BA/BS degree or equivalent professional experience.

• Over 5 years of experience in data engineering, specifically in building and managing production data pipelines and platforms.

• Extensive experience with Spark and distributed data processing techniques.

• Proficient in designing batch, real-time, and streaming data solutions using Kafka, Spark Structured Streaming, and CDC.

• Skilled in implementing data quality, observability, and reliability across production data systems.

• Familiarity with cloud data infrastructure, CI/CD practices, and infrastructure-as-code.

• Proven track record of leading complex data engineering projects from inception to completion.

• Strong programming and SQL proficiency.

• Ability to tackle ambiguous challenges and assess architectural trade-offs.

• Comprehensive understanding of the end-to-end data ecosystem.

• Experience with data governance and privacy issues, including PII management, retention, deletion, data residency, GDPR, or CCPA.

• Knowledge of event instrumentation and governance, including event schemas, validation, and schema evolution.

• Capability to collaborate on intricate technical issues and establish engineering best practices.

• Willingness to adopt AI and emerging technologies.

• Valid right-to-work authorization as per the country of employment.

🏝️ Benefits

• Equity (RSUs) for every permanent Webflower employee.

• Comprehensive medical, dental, and vision coverage for full-time employees and their dependents, with Webflow covering the majority of premiums.

• 12 weeks of paid parental leave available for all parents.

• An additional 6+ weeks of paid leave specifically for birthing parents.

• Inclusive care services for family planning, menopause, and midlife transitions.

• Flexible vacation policy.

• Paid holidays throughout the year.

• Sabbatical program available.

• Mental health resources, including therapy and coaching services.

• 401(k) plan with a 100% employer match up to $6,000 per year in the U.S.

• Support for retirement savings on a global scale.

• Monthly stipends for work and wellness-related expenses, including Wi-Fi and fitness activities.

• Eligibility for the annual WIN bonus program.

• Potential eligibility for temporary employees to receive paid holidays, time off, statutory leaves, and company-sponsored medical benefits, depending on contract and location.