Resident Solutions Architect – MLOps

This is a fully remote position, open to applicants in United States.

📋 Description

• Take the lead on engagements from initial discovery through to final delivery, demonstrating full ownership and accountability.

• Design, implement, and enhance large-scale Spark/Databricks workloads with a focus on scalability and cost efficiency.

• Utilize expert-level Spark principles to troubleshoot and optimize distributed data jobs and SQL workloads.

• Develop and conduct Proofs of Concept (PoCs) and workshops to effectively showcase solution vision.

• Serve as a technical advocate for clients, proactively identifying issues and implementing solutions.

• Work collaboratively with product and engineering teams to enhance the customer experience.

• Promote best practices in PySpark, Databricks, and Lakehouse architecture while mentoring junior engineers.

⛳️ Requirements

• 5 to 10 years of experience in data engineering or analytics solution delivery.

• Over 3 years of practical experience with Databricks.

• In-depth knowledge of Spark Internals, PySpark, and performance tuning within Databricks SQL.

• Strong understanding of Delta Lake, Structured Streaming, and cloud infrastructure.

• Proven capability to identify and resolve complex technical challenges with minimal supervision.

• Excellent ability to simplify technical complexities for business stakeholders.

🏝️ Benefits

• Flexible work arrangements.

• Opportunities for professional development.