Staff Software Engineer – Apache Spark

This is a fully remote position, open to applicants in California, +3 more states.

📋 Description

• Design, implement, and deliver innovative features for Cloudera’s Data Engineering Experience, functioning at a vast scale across thousands of production nodes.

• Act as a key contributor to Apache Spark, actively influencing the future of distributed data processing within the open-source community.

• Create high-performance features utilizing Scala, Java, and Python on contemporary data platforms.

• Acquire and apply expert-level knowledge in fundamental distributed data processing concepts, including: SQL Planners and Optimizers, data layout and modern table formats such as Apache Parquet and Iceberg, as well as fault tolerance and resilience in large-scale distributed systems.

• Cultivate a comprehensive technical understanding of components within the Cloudera Data Engineering Experience, particularly focusing on Iceberg and Spark, applying this knowledge to daily responsibilities.

• Engage directly with extensive distributed systems, scaling from hundreds to thousands of nodes in live production environments.

• Perform thorough root cause analysis, troubleshoot complex system-level deployment issues, and resolve failures to uphold high system quality.

• Enhance internal infrastructure and tools to optimize development, testing, and deployment processes.

• Collaborate closely with a high-impact, distributed team and stakeholders to advance product vision and execution.

⛳️ Requirements

• 5-7+ years of experience in professional software development.

• Strong expertise in Java, Scala, or other JVM-based languages.

• Solid background in the design and development of distributed systems.

• A keen interest in clean coding practices, attention to detail, and a commitment to software quality and maintainability.

• Excellent oral and written communication skills for effective collaboration within a distributed team.

• Proven ability to research, troubleshoot, and work independently without constant supervision.

• An open-minded attitude with a willingness to learn new technologies and a strong passion for creating exceptional products.

🏝️ Benefits

• Generous PTO Policy.

• Support for work-life balance with Unplugged Days.

• Flexible Work From Home Policy.

• Mental & Physical Wellness programs.

• Phone and Internet Reimbursement program.

• Access to Continued Career Development opportunities.

• Comprehensive Benefits and Competitive Packages.

• Paid Volunteer Time.

• Employee Resource Groups.