Senior Data Engineer, ADB, Python

This is a fully remote position, open to applicants in Bulgaria.

📋 Description

• Establish and implement best practices and coding standards throughout the project.

• Perform detailed code reviews to guarantee compliance with defined guidelines and uphold superior code quality.

• Operate both autonomously and collaboratively with team members.

• Provide clear guidance to team members and assist in managing daily operations.

• Regularly communicate with clients.

• Design, develop, and sustain robust and scalable Spark applications.

• Write clean, maintainable, and efficient code in accordance with best practices and coding standards.

• Enhance code for performance and scalability, ensuring effective data management.

• Collaborate closely with cross-functional teams to deliver high-quality software solutions.

• Identify and troubleshoot technical issues, ensuring the reliability and performance of applications.

• Create and maintain comprehensive documentation for code, processes, and workflows.

⛳️ Requirements

• Over 5 years of practical experience in software development.

• Extensive experience with Apache Spark, including platforms like Databricks and/or Azure Synapse/Fabric.

• Proficient in Python, with strong skills in data manipulation using Pandas/Polars and similar libraries.

• Solid understanding of columnar data storage formats, particularly Parquet, along with practical experience using Delta Tables.

• Established expertise in data processing, analysis, and transformation workflows.

• Strong analytical and problem-solving skills with a keen attention to detail.

• Practical and pragmatic approach to balancing standardized processes with the flexibility needed to effectively meet project goals.

• Excellent organizational skills, capable of self-management, task prioritization, workload structuring, and meeting tight deadlines.

• Solid understanding of microservices architecture and its application in scalable systems.

🏝️ Benefits

• Flexible working arrangements.

• Opportunities for professional development.