Senior Data Engineer, Data Analytics

This is a fully remote position, open to applicants in California, +2 more states.

📋 Description

• Collaborate with software and hardware teams focused on robotics to define, gather, and refine data for analytics and troubleshooting.

• Create and uphold ETL pipelines that convert raw robot logs and telemetry into organized datasets utilizing Spark, Airflow, or similar orchestration tools, along with AWS data services.

• Take ownership of gold-layer datasets that drive fleet dashboards, reliability models, and business performance metrics.

• Set up freshness SLAs, documentation, and monitoring procedures to ensure reliable analytics and data science datasets.

• Execute data quality assessments, schema evolution, and metadata management using internal data registry and cataloging systems.

• Work alongside reliability, analytics, and machine learning teams to design effective data models.

• Occasionally assist in developing shared libraries or APIs in Python, Java, or C++ to support data capture and consumption.

⛳️ Requirements

• More than 5 years of experience as a Data Engineer or in a comparable role focused on building and maintaining production data pipelines.

• Strong expertise in Apache Spark or a similar distributed data processing framework.

• Complementary programming skills in Python, Java, and/or Scala.

• Experience with Airflow, Dagster, Prefect, or other data orchestration platforms.

• Proficiency with Avro, Parquet, and structured/numeric datasets.

• Knowledge of table formats like Apache Iceberg and Delta Lake, as well as medallion architecture.

• Solid comprehension of data modeling, schema evolution, and best practices in data quality.

• Ability to logically model datasets and physically partition them for optimal query performance in analytical engines and playback/root-cause analysis.

• Comfort in collaborating cross-functionally with software, hardware, and analytics teams.

• Current authorization to work in the United States.

• Familiarity with data versioning or immutable dataset design is a plus.

• Experience with vision-data pipelines and multimodal data processing is a plus.

• Familiarity with C++ and a willingness to contribute to logging or data serialization libraries is a plus.

• Experience with data catalog systems and metadata management is a plus.

🏝️ Benefits

• 401(k) plan featuring a 6% company match.

• Company stock options available.

• Comprehensive medical, dental, vision, and short/long-term disability insurance fully covered for employees.

• Benefits eligibility begins on the first day of employment.

• Access to Employee Assistance Program (EAP).

• Flexible, unlimited PTO along with 12 company holidays, including a winter shutdown, for exempt employees.

• 10 vacation days, paid sick leave, and 12 company holidays, including a winter shutdown, offered annually for non-exempt employees.

• Catered lunches four times a week and healthy snacks and refreshments available at Salem and Pittsburgh locations.

• Generous paid parental leave programs.

• Flexible work arrangements.

• Opportunities for professional development and tuition reimbursement programs.

• Relocation assistance for eligible roles.

• Annual discretionary bonus for eligible roles.