Backend Infrastructure Engineer – Connectors, Rust

This is a fully remote position, open to applicants in India.

📋 Description

• Take ownership of and enhance Feldera's input and output connectors for data lakes (Delta Lake, Iceberg), streaming systems (Kafka and the wider Kafka ecosystem), and databases (Postgres and other OLTP/OLAP systems).

• Develop robust CDC ingestion processes that transform upstream changes into accurate, ordered, and consistent change streams within Feldera pipelines.

• Design and refine the shared abstractions, APIs, and tools that facilitate fast and consistent authoring, testing, and operation of connectors.

• Engage at the level of table formats (such as Parquet, Delta, Iceberg metadata), serialization formats (including Avro, JSON, Protobuf), and wire protocols to ensure seamless and efficient integration with each system.

• Guarantee that connectors are dependable and function without data loss or duplication beyond established assurances.

• Optimize connector throughput and latency to meet the demands of high-performance production workloads.

• Diagnose intricate distributed systems issues affecting both Feldera and external systems in client environments.

⛳️ Requirements

• Strong expertise in Rust, or substantial systems programming experience in a similar language (C++, Go, Java/Scala) with a proven ability to quickly learn Rust.

• Proven experience in developing data integrations, connectors, or pipelines in production environments — facilitating data movement between storage systems, streaming platforms, or databases.

• Hands-on familiarity with one or more of the following: Kafka, Delta Lake, Iceberg, Postgres, or comparable streaming/lakehouse/database systems.

• Working knowledge of data serialization and table formats (for example, Avro, Protobuf, JSON, Parquet).

• Comprehension of distributed systems fundamentals: delivery semantics, ordering, checkpointing, and fault recovery.

• Strong problem-solving abilities and the capacity to troubleshoot complex issues across system boundaries.

• Self-motivated with excellent communication skills and the ability to effectively collaborate in a remote team setting.

🏝️ Benefits

• Competitive salary & meaningful equity

• Medical, dental & vision - 90% of premiums covered by Feldera

• HSA & FSA

• 401(k)

• Fully remote