Senior Data Engineer, Databricks, PySpark

This is a fully remote position, open to applicants in India.

📋 Description

• Comprehends the overall scope and assists operations with monitoring, dashboards, and related tasks.

• Collaborates with the architect and technical lead on design processes.

• Continuously monitors the cost and performance metrics of the system.

• Works alongside the Business Analyst to define integration requirements.

• Possesses the ability to troubleshoot performance issues and other functional challenges.

• Demonstrates attention to detail and documents key decisions made throughout the project.

• Capable of managing fast-paced projects and willing to address production issues as they arise.

• Should be a quick learner who can adapt to new technologies efficiently.

• Requires prompt communication and responsiveness.

⛳️ Requirements

• Must be a collaborative team player.

• Requires a minimum of 5 years of experience in IT development.

• Strong analytical and problem-solving skills are essential.

• Proven experience in designing solutions, conducting code reviews, and mentoring junior engineers is required.

• Must possess strong SQL and backend experience, particularly in data-driven projects.

• Required experience includes: Python/PySpark, SQL, PL/SQL, Databricks, Java, and C#.

• Preferred experience includes: Azure, Kafka, Node.js, and Azure Data Factory.

🏝️ Benefits

• Opportunity to work in a dynamic and innovative environment.

• Professional development and growth opportunities.

• Competitive salary and benefits package.