Senior Solution Architect

This is a fully remote position, open to applicants in India.

📋 Description

• Oversee the design and execution of secure, high-performance data architectures at an enterprise level on the Databricks Lakehouse Platform.

• Offer hands-on expertise and guide the development of intricate data engineering pipelines utilizing Apache Spark, PySpark, SQL, and Scala.

• Detect, analyze, and address performance challenges in extensive data processing, query optimization, and cluster configurations.

• Act as the senior technical consultant to client leadership, engineering, and data science teams regarding data governance, security, MLOps, and operational excellence.

• Create and conduct advanced workshops and training sessions, while also providing continuous mentorship to client teams.

• Promote the adoption of innovative Databricks features and tools, including Photon, AI/BI, and Mosaic AI.

• Guarantee flawless, optimized, and secure integration with AWS, Azure, and GCP, covering storage, networking, IAM, and security services.

⛳️ Requirements

• 8+ years of experience in data engineering, big data architecture, or software engineering with an emphasis on data platforms.

• 5+ years of extensive, hands-on experience in designing, implementing, and enhancing Databricks solutions.

• Mastery in Apache Spark, PySpark, Spark SQL, Scala, and large-scale data processing.

• Strong infrastructure experience with AWS, Azure, and GCP, including S3, ADLS, networking, and security models.

• In-depth knowledge of Databricks Lakehouse architecture, Delta Lake, Unity Catalog, ETL/ELT, data governance, and reliability.

• Proficient in Python, Scala, advanced SQL, Docker, Kubernetes, and CI/CD.

• Outstanding client-facing and presentation abilities for both technical and C-level audiences.

• Demonstrated leadership in client engagements and capability to influence stakeholder decision-making.

• Strong analytical and problem-solving skills combined with a proactive, consultative approach.

• Databricks Certified Professional or higher certification is preferred.

• Relevant AWS, Azure, or Google Professional Data Engineer certifications are preferred.

• Experience in MLOps, generative AI, advanced analytics, and senior consulting or solution architecture is preferred.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Opportunities for continuous learning and professional development.

• Flexible working hours and remote work options.

• Collaborative and innovative work environment.