Senior Technical Architect – Databricks

This is a fully remote position, open to applicants in India.

📋 Description

• Designing and implementing cloud-native, hybrid, or multi-cloud solutions

• Constructing data pipelines utilizing PySpark with Databricks

• Partnering with teams to execute technical workloads

• Developing roadmaps and architectural plans for migration workloads on AWS

• Guiding and overseeing data engineering teams

⛳️ Requirements

• Over 15 years of relevant experience in creating cloud-native, hybrid, or multi-cloud solutions

• Proficient in implementing Databricks - developing data pipelines with PySpark

• Familiarity with Databricks Workspaces, Notebooks, Delta Lake, and APIs

• Expertise in production-grade solutions, including: AWS (Redshift, S3, Glue, Lambda, Airflow), PySpark, Python, and data pipelines using Glue/Airflow/Sagemaker

• Practical experience with extensive cloud-based migration workloads involving SQL and NoSQL databases

• Background in migrating databases to AWS

• Strong capability in creating roadmaps and architectures to implement migration workloads on AWS

• Exposure to ETL tools and data warehousing

• Proficient in SQL and query optimization

• Skilled in SQL-based technologies (MySQL, Oracle DB, SQL Server, etc.)

• Experience in the creation and maintenance of data dictionaries, metadata repositories, and data lineage documentation

• Proven experience in building and supporting large-scale systems in a production environment

• Strong abilities to mentor and manage teams of junior and senior data engineers, leading end-to-end delivery of technical workloads

• Experience utilizing GitHub/CodeCommit for development activities

🏝️ Benefits

• Abundant opportunities for learning

• Engage and collaborate with colleagues from diverse experiences and backgrounds across the globe