Resident Solution Architect

This is a fully remote position, open to applicants in India.

📋 Description

• Collaborate directly with enterprise clients as a reliable technical advisor.

• Comprehend customer business and technical needs, transforming them into scalable data architectures.

• Architect and implement contemporary Lakehouse / Data + AI frameworks utilizing Databricks.

• Innovate and oversee POCs, technical workshops, and architecture showcases.

• Engage extensively with Apache Spark / PySpark, SQL, and the Databricks environment.

• Craft scalable data ingestion, transformation, and processing workflows.

• Leverage Delta Lake, Unity Catalog, and capabilities of the Databricks platform.

• Assist in data migration and modernization projects.

• Integrate Databricks with AWS, Azure, or GCP.

• Diagnose performance, scalability, reliability, and data pipeline challenges.

• Collaborate with customer engineering, data science, architecture, and leadership teams.

• Offer technical insights on data engineering, analytics, ML/AI, and cloud architecture.

• Produce reference architectures, technical documentation, and implementation advice.

• Facilitate production deployment and encourage the adoption of Databricks solutions.

• Lead technical workshops, enablement sessions, and knowledge-sharing initiatives.

⛳️ Requirements

• At least 9+ years of experience in the field.

• Proficient experience with Databricks.

• Strong expertise in Apache Spark / PySpark.

• Solid SQL skills.

• Comprehensive understanding of Data Engineering principles.

• Experience in designing data pipelines and data platforms.

• Familiarity with Lakehouse / Data Warehouse / Big Data architectures.

• Proficient in at least one cloud service: AWS, Azure, or GCP.

• Extensive customer-facing and consulting experience.

• Experience in architecture and design.

• Exceptional communication and presentation abilities.

• Familiarity with Delta Lake, Unity Catalog, MLflow, Kafka, Streaming, Data migration, MLOps, Machine Learning, GenAI, Data governance, Terraform / CI/CD, Snowflake, and the Hadoop ecosystem are considered beneficial.

• Essential skills include Data Engineering, Python, and Solution Architecture.

• Additional skills that are advantageous include SQL, Azure, and Databricks.

🏝️ Benefits

• Opportunity to work with cutting-edge technologies in data architecture and AI.

• Collaborate with a diverse team of experts dedicated to innovation.

• Engage in professional development through workshops and training sessions.

• Access to a supportive and dynamic work environment.