Staff Software Engineer, Data Platform

This is a fully remote position, open to applicants in California, +2 more states.

📋 Description

• Design and execute scalable data pipelines for the ingestion and processing of telemetry, logs, and sensor data originating from the robot fleet and its corresponding cloud software.

• Create and sustain data ingestion agents that operate directly on robot software to facilitate high-volume data ingestion in environments with limited connectivity.

• Develop and enhance data formats and protocols that are optimized for the transmission, storage, and querying of data recordings, sensor data, and telemetry.

• Build and maintain observability systems utilizing tools such as Fluent Bit and OpenTelemetry for real-time monitoring and analytics of fleet operations.

• Implement strategies to prepare high-volume, high-velocity data for analysis using technologies like Spark and Kafka.

• Construct and refine tools for internal stakeholders to support business intelligence, long-term fleet analytics, and forecasting through AWS S3, Athena, and SageMaker.

• Utilize IoT experience to enhance data collection and processing pipelines from robot sensors and edge devices.

• Play a key role in enhancing robot performance, operational insights, and the scalability of cloud-based systems.

⛳️ Requirements

• Over 5 years of experience in building and scaling cloud-based data platforms.

• Knowledge of cloud service providers such as AWS, GCP, or Azure.

• Expertise in big data frameworks like Spark, Kafka, Beam, or Flink.

• Familiarity with open-source data formats such as Parquet, Arrow, and Iceberg.

• Understanding of data protocols like Avro and Protobuf.

• Experience with observability tools including OpenTelemetry and Prometheus.

• Proficient in implementing metrics, tracing, and logging systems.

• Skilled in Java, Scala (any JVM), or Python.

• Strong grasp of distributed systems and microservices architectures.

• Valid authorization to work in the United States.

• Experience in robotics, autonomous vehicles, or sensor-intensive workloads is highly preferred.

• Familiarity with IoT systems, edge computing, or embedded devices is a plus.

• Experience with data catalog tools such as DataHub, Amundsen, or Databricks Unity Catalog.

• Familiarity with Databricks, Kubernetes, Bazel/Blaze or other build systems, C++, Rust, and robot data formats like MCAP or ROS are additional qualifications.

🏝️ Benefits

• 401(k) Plan with a 6% company match.

• Company stock options.

• Comprehensive medical, dental, vision, and short/long-term disability insurance fully paid by the company for employees.

• Benefits eligibility begins on the first day of employment.

• Employee Assistance Program (EAP).

• Flexible, unlimited PTO and 12 company holidays, including a winter shutdown, for exempt employees.

• 10 vacation days, paid sick leave, and 12 company holidays, including a winter shutdown, annually, for non-exempt employees.

• Catered lunches four times a week along with healthy snacks and refreshments available at Salem and Pittsburgh locations.

• Generous paid parental leave programs.

• Flexible work arrangements.

• Opportunities for professional development and tuition reimbursement programs.

• Relocation assistance for eligible positions.

• Annual discretionary bonus for eligible roles.