Senior Rust Data Engineer

This is a fully remote position, open to applicants in Pennsylvania.

📋 Description

• Oversee the design and scaling of high-throughput data services and ingestion pipelines.

• Develop high-performance, low-latency data infrastructure utilizing Rust.

• Create resilient APIs, data contracts, and schemas.

• Connect data services with cloud warehouses and lakehouse platforms.

• Enhance distributed data processing, storage, caching, and query performance.

• Lead the technical architecture and advocate for best practices in scalable data platforms.

⛳️ Requirements

• A minimum of 8 years of experience in software or data engineering.

• Demonstrated expertise in delivering robust, distributed systems and large-scale data platforms in a production environment.

• Strong, hands-on experience in constructing multi-threaded, asynchronous services with Rust.

• In-depth knowledge of memory management and concurrency patterns.

• Significant experience in establishing data contracts and schemas using Protobuf/gRPC, Avro, or OpenAPI.

• Familiarity with backward compatibility and schema evolution strategies.

• Extensive expertise in at least one major cloud service provider: AWS, GCP, or Azure.

• Proven mastery of at least one enterprise analytical platform: Snowflake, Google BigQuery, Databricks (Delta Lake), or AWS Glue/Redshift.

• Advanced understanding of columnar storage (Parquet), partitioning/clustering, distributed caching, and query engine optimization.

🏝️ Benefits

• Employees have the option to work remotely.