Senior Data Engineer, B2B – Databricks, Python, Azure

This is a fully remote position, open to applicants in Bulgaria, +1 more country.

📋 Description

• Establish and uphold best practices and coding standards throughout the project.

• Perform code reviews to ensure high standards of code quality.

• Work autonomously while also collaborating closely with the team.

• Provide clear guidance to team members and assist in managing daily operations.

• Maintain regular communication with the client.

• Design, develop, and sustain robust, scalable Spark applications.

• Write clean, maintainable, and efficient code.

• Enhance code for performance, scalability, and effective data handling.

• Collaborate with cross-functional teams to deliver superior software solutions.

• Identify and resolve technical challenges to ensure application reliability and performance.

• Create and maintain comprehensive documentation for code, processes, and workflows.

⛳️ Requirements

• Over 5 years of practical experience in software development.

• Extensive knowledge of Apache Spark, including Databricks and/or Azure Synapse/Fabric.

• Proficiency in Python programming.

• Strong skills in data manipulation using Pandas/Polars and similar tools.

• Familiarity with Parquet and hands-on experience with Delta Tables.

• Expertise in data processing, analysis, and transformation workflows.

• Strong analytical and problem-solving skills.

• Capability to balance standardized processes with the flexibility required to meet project objectives.

• Excellent organizational skills to self-manage, prioritize tasks, structure workload, and meet tight deadlines.

• Understanding of microservices architecture and its implementation in scalable systems.

• Experience with Azure Cloud services or other major cloud platforms, including SaaS offerings like Service Bus, Data Lake, Blob Storage, and Redis (preferred).

• Familiarity with FastAPI (preferred).

• Proficient in Docker and Kubernetes (preferred).

🏝️ Benefits

• Remote work arrangement.

• Standard or B2B contract options.