Software Engineer, Data Substrate

This is a fully remote position, open to applicants in California.

📋 Description

• Design, develop, and maintain infrastructure and scalable frameworks to facilitate data ingestion, processing, and analysis.

• Collaborate with stakeholders, analysts, and product teams to comprehend business needs and transform them into technical solutions.

• Architect and implement data solutions utilizing modern data technologies like Kafka, Spark, Hive, Hudi, Presto, Airflow, and cloud-based services such as AWS Lakeformation, Glue, and Athena.

• Create and execute frameworks and solutions that prioritize performance, reliability, and cost-effectiveness.

• Ensure the quality, integrity, and security of data throughout its lifecycle.

• Keep abreast of emerging technologies and best practices in the realm of big data technologies.

• Mentor early-career engineers and foster a culture of continuous learning and improvement.

⛳️ Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related discipline.

• Over 5 years of experience in software development or a comparable field.

• Strong command of programming languages such as Python, Java, or Scala.

• Extensive experience in building frameworks for big data technologies, including Spark, Kafka, Hive, and distributed computing systems.

• Familiarity with AWS technologies at scale.

• Solid grasp of software engineering principles, encompassing object-oriented and functional programming paradigms, design patterns, and code quality practices.

• Exceptional problem-solving and analytical abilities.

• Strong verbal and written communication skills, with the capability to collaborate effectively in a cross-functional team environment.

🏝️ Benefits

• Competitive salary

• Generous time-off policies

• Extensive parental and wellness leave

• Healthcare benefits

• Retirement savings program