Senior Data Engineer, Databricks

This is a fully remote position, open to applicants in Poland.

📋 Description

• Develop and execute data processing solutions utilizing Databricks for extensive and varied datasets.

• Create, enhance, and maintain data pipelines leveraging Python and cloud-native technologies.

• Work closely with solution architects to establish and adhere to data engineering best practices.

• Maintain data consistency, security, and scalability in cloud-based environments.

• Engage throughout the entire Software Development Life Cycle (SDLC).

• Utilize contemporary data frameworks, programming practices, and DevOps principles to deliver efficient solutions.

⛳️ Requirements

• Proven experience in data engineering within a commercial setting.

• Practical expertise in Databricks.

• Strong programming capabilities in Python for automation and data transformation tasks.

• Familiarity with at least one major cloud platform: AWS, Azure, or GCP.

• Excellent communication abilities.

• Proficiency in English.

• Nice to have: a solid grasp of SQL, including query optimization and data modeling.

• Nice to have: experience with DevOps methodologies, CI/CD pipelines, and Infrastructure as Code (Terraform, Bicep).

• Nice to have: exposure to real-time data streaming technologies such as Kafka or Spark Streaming.

• Nice to have: knowledge of cloud storage solutions including Data Lake, Snowflake, or Synapse.

• Nice to have: practical experience with PySpark for distributed data processing.

• Nice to have: relevant certifications such as Databricks Certified Data Engineer Associate or cloud-related data certifications.

🏝️ Benefits

• Fully remote work environment.

• B2B cooperation contract.

• Opportunities for project-based or permanent positions through Optiveum.