Senior Data Engineer, ADB, Python

This is a fully remote position, open to applicants in Kazakhstan.

📋 Description

• Establish and implement best practices and coding standards throughout the project.

• Perform comprehensive code reviews to guarantee compliance with established guidelines and uphold high code quality.

• Collaborate effectively with team members while also working independently.

• Provide clear instructions to team members and assist in managing day-to-day operations.

• Maintain regular communication with the client.

• Design, develop, and sustain robust and scalable Spark applications.

• Write clean, maintainable, and efficient code in accordance with best practices and coding standards.

• Enhance code performance and scalability to ensure effective data management.

• Collaborate closely with cross-functional teams to deliver high-quality software solutions.

• Identify and troubleshoot technical issues to ensure application reliability and performance.

• Create and maintain detailed documentation for code, processes, and workflows.

⛳️ Requirements

• Over 5 years of practical experience in software development.

• In-depth experience with Apache Spark, including platforms such as Databricks and/or Azure Synapse/Fabric.

• Proficient in Python, with strong capabilities in data manipulation using Pandas/Polars and similar tools.

• Solid understanding of columnar data storage formats, especially Parquet, with hands-on experience utilizing Delta Tables.

• Demonstrated expertise in data processing, analysis, and transformation workflows.

• Strong analytical and problem-solving skills with attention to detail.

• Excellent organizational abilities with the capacity to self-manage, prioritize tasks, structure workload, and meet tight deadlines.

• Strong understanding of microservices architecture and its application in scalable systems.

🏝️ Benefits

• Health insurance

• Flexible work arrangements