Senior Data Platform Engineer

This is a fully remote position, open to applicants in California, +3 more states.

📋 Description

• Design, develop, test, and maintain distributed batch and streaming pipelines that ingest, transform, validate, and deliver both structured and semi-structured data across production systems.

• Create and enhance workflows utilizing dbt, Dagster, Airflow, or similar tools.

• Set standards for testing, deployment, dependency management, data quality, and observability for workflows.

• Architect data models, schemas, partitioning strategies, and storage patterns tailored for large-scale analytical workloads.

• Identify and resolve issues related to performance, scalability, availability, and cost-efficiency within multi-petabyte data environments.

• Collaborate with software engineering teams to define event schemas and establish reliable logging, telemetry, and instrumentation.

• Develop systems for metadata, lineage, governance, and semantic modeling to ensure consistent business definitions and enable secure self-service analytics.

• Create data interfaces and foundational platforms for internal AI applications.

• Oversee production systems, troubleshoot incidents, document operational procedures, and take part in an on-call rotation following necessary onboarding and training.

• Assess architectural options, pinpoint system constraints, and select suitable data structures, algorithms, database designs, and distributed processing patterns.

⛳️ Requirements

• Bachelor's degree or foreign equivalent in Computer Science, Computer Engineering, Data Science, Information Systems, or a closely related technical or quantitative field with significant coursework in Engineering.

• Minimum of five years of progressive professional experience in software engineering, data engineering, data infrastructure, or a closely related field.

• Proven experience in designing and implementing production data pipelines and distributed data-processing systems.

• Demonstrated experience with data transformation or workflow orchestration technologies such as dbt, Dagster, Airflow, or comparable platforms.

• Experience in designing data models, schemas, and storage strategies for large-scale analytical databases or cloud data warehouses.

• Proficiency in programming languages such as Python, Go, Java, Scala, or other general-purpose languages used for building production data systems.

• Expertise in SQL, database performance optimization, data quality testing, and production monitoring.

• Understanding of software engineering practices, including version control, automated testing, code reviews, continuous integration, deployment automation, and technical documentation.

• Familiarity with web application telemetry, event instrumentation, logging systems, APIs, and distributed service architecture.

• Ability to effectively communicate technical designs, risks, and trade-offs to engineering, data science, analytics, and business stakeholders.

• Export-control eligibility: U.S. person, able to access export-controlled information without required authorization, or eligible and likely to obtain necessary authorization.

🏝️ Benefits

• Discretionary bonus.

• Equity awards.

• Comprehensive medical, dental, and vision insurance fully covered by CoreWeave.

• Company-sponsored life insurance.

• Optional supplemental life insurance.

• Short and long-term disability insurance.

• Flexible spending account.

• Health savings account.

• Tuition reimbursement.

• Opportunity to participate in the Employee Stock Purchase Program (ESPP).

• Mental wellness benefits through Spring Health.

• Family-forming support provided by Carrot.

• Paid parental leave.

• Flexible, full-service childcare support through Kinside.

• 401(k) plan with a generous employer match.

• Flexible paid time off (PTO).

• Catered lunch every day at our office and data center locations.

• A relaxed work environment.

• A work culture that emphasizes innovative disruption.

• Entrepreneurial spirit and independent thinking encouraged.

• Collaboration and opportunities to devise innovative solutions.

• Opportunities for growth within the organization.