Resident Solutions Architect – Spark, Databricks

This is a fully remote position, open to applicants in United States.

📋 Description

• Oversee projects from initial discovery through to final delivery with complete accountability

• Design and enhance large-scale Spark/Databricks workloads

• Diagnose and optimize distributed data jobs and SQL workloads

• Create and implement Proofs of Concept (PoCs) and workshops

• Serve as a technical advocate for clients

• Collaborate with product and engineering teams

• Promote best practices in PySpark and Databricks while providing mentorship to junior engineers.

⛳️ Requirements

• 5-10 years of experience in data engineering or analytics solution delivery

• Expertise in Databricks with over 3 years of practical experience

• In-depth knowledge of Spark Internals and PySpark

• Strong understanding of Delta Lake and Structured Streaming

• Demonstrated capability to identify and resolve complex technical challenges

• Excellent communication skills to convey technical complexities to business leaders.

🏝️ Benefits

• Health insurance

• Flexible working hours

• Professional development opportunities