Senior Data Engineer, Rust

This is a fully remote position, open to applicants in Pennsylvania.

📋 Description

• Oversee the design and scaling of high-throughput data services and ingestion pipelines.

• Develop high-performance, low-latency data infrastructure utilizing Rust.

• Create resilient APIs, data contracts, and schemas.

• Integrate data services with cloud data warehouses and lakehouse platforms.

• Enhance distributed data processing, storage, caching, and query performance.

• Lead the technical architecture and implement best practices for scalable data platforms.

⛳️ Requirements

• 8+ years of experience in software or data engineering.

• Demonstrated expertise in delivering robust, distributed systems and large-scale data platforms in a production environment.

• Strong hands-on experience in building multi-threaded, asynchronous services using Rust.

• In-depth knowledge of memory management and concurrency patterns.

• Extensive experience in establishing data contracts and schemas with Protobuf/gRPC, Avro, or OpenAPI.

• Familiarity with backward compatibility and schema evolution strategies.

• Significant expertise in at least one major cloud provider: AWS, GCP, or Azure.

• Mastery of at least one enterprise analytical platform: Snowflake, Google BigQuery, Databricks (Delta Lake), or AWS Glue/Redshift.

• Advanced understanding of columnar storage (Parquet), partitioning/clustering, distributed caching, and query engine optimization.

🏝️ Benefits

• Employees have the option to work remotely.