This is a fully remote position, open to applicants in India.

• Contribute improvements and fixes to the Apache Spark open-source project.

• Upgrade and ensure compatibility with the latest Spark releases.

• Enhance Spark's internal mechanisms for better performance, scalability, and reliability.

• Design and create solutions for distributed data processing.

• Troubleshoot complex performance and stability challenges associated with Spark.

• Collaborate with product and platform teams on architectural and technical projects.

• Extensive experience with Apache Spark internals and distributed systems.

• Practical experience contributing to open-source initiatives.

• Proficient in Java and/or Scala programming.

• In-depth knowledge of query execution, distributed processing, and performance tuning.

• Strong problem-solving and debugging skills.

• Capability to work autonomously and lead technical projects.

• Good to Have

• Familiarity with Kubernetes and cloud-native environments.

• Understanding of JVM tuning and system optimization.

• Contributions to Apache or other open-source communities.

• Experience with large-scale analytics or data platforms.

• Competitive salary and performance-based bonuses.

• Flexible working hours and remote work options.

• Opportunities for professional development and continuous learning.

• Inclusive and diverse work environment.

• Health, dental, and vision insurance.

Spark Developer

People also viewed