Tech Lead – Azure Databricks

This is a fully remote position, open to applicants in India.

📋 Description

• Develop, implement, and sustain the information data lake and insight platforms to support organizational decision-making.

• Collaborate with business stakeholders and customers to grasp data and reporting needs.

• Integrate datasets to address business inquiries and promote growth.

• Design ETL processes for importing data into data warehouses, data lakes, and reporting applications.

• Work alongside business clients and development teams to outline requirements and deliver adaptable, scalable, end-to-end solutions.

• Lead business intelligence initiatives encompassing requirements, data modeling, ETL, metadata, reporting, and dashboard creation.

• Design, develop, manage, and facilitate the business utilization of extensive datasets.

• Establish SLAs for assigned areas of responsibility.

• Create process maps, workflows, business cases, and basic business models.

• Assess the impacts of requested modifications, enhancements, and bug fixes while identifying dependencies.

• Execute code or configure/customize products and offer design and architectural insights.

• Evaluate frameworks and tools, review code, and provide suggestions for improvement.

• Deliver application- or function-level architectural designs and documentation.

• Apply architectural patterns and communicate architectural direction to the business.

• Diagnose the causes of errors and propose potential solutions.

⛳️ Requirements

• 8+ years of relevant experience.

• Proficient in data modeling, SQL, ETL, data warehousing, and data lakes.

• Experience in writing SQL and Python scripts.

• Skilled in creating dashboards and reports using Microsoft Power BI.

• Proficient in data transformation using Azure Data Factory.

• Familiar with Spark and Azure Databricks.

• Knowledge of Python, PySpark, or JavaScript.

• Familiarity with Azure Databricks and MPP databases.

• Experience in data lake development.

• Exposure to NoSQL databases such as Cosmos DB and MongoDB.

• Experience adhering to Agile methodologies.

• Proficient with distributed version control systems like Git.

• Experience with Mulesoft, Kingswaysoft, or Marketo.

• Sound knowledge of requirement management and analysis processes, tools, and methodologies.

• Understanding of technology product/platform standards and specifications.

• Familiarity with architectural industry tools and frameworks.

• Understanding of architectural elements, SDLC, and methodologies.

• Knowledge of statistical and machine learning techniques including classification, linear regression modeling, clustering, and decision trees.

• Familiarity with both commercial and open-source data science/analytics software tools.

🏝️ Benefits

• Flexible work arrangements.

• Inclusive team environment.

• Career-oriented skilling models.

• Continuous learning, unlearning, and relearning opportunities.

• Agile self-determination, trust, transparency, and open collaboration.

• Support for achieving business goals.

• Stable employment.

• Positive atmosphere and ethical corporate culture.