Senior Data Engineer

This is a fully remote position, open to applicants in United Kingdom.

📋 Description

• Accountable for the design and development of software components that facilitate data processing and persistence for large-scale data solutions.

• Create data processing software primarily intended for deployment within Big Data technologies.

• Involves the entire software lifecycle, including design, coding, testing, and defect resolution.

• Collaborate with Architects and Lead Engineers to ensure the software meets non-functional requirements.

• Partner with colleagues to address implementation challenges and maintain high standards of code quality and maintainability.

• Set a standard for code quality through leadership by example.

• Coordinate with operations teams to guarantee operational readiness.

• Provide guidance to customers and managers regarding the estimated effort and technical considerations of user stories and user journeys.

• Mentor and coach team members.

⛳️ Requirements

• Extensive software development experience in at least one of the following: Java, Scala, or Python.

• Experience in software development using data-processing platforms from providers such as AWS, Azure, GCP, and Databricks.

• Proven track record of developing significant components for large-scale data processing solutions and deploying them in production environments.

• Proficient in SQL and its extensions for analytical queries.

• Strong understanding of ETL/ELT data processing pipelines and design patterns.

• Familiar with the key features and challenges associated with distributed data processing frameworks, data stores, and data serialization formats.

• Capable of writing high-quality, testable code and experienced in automated testing.

• Familiarity with Continuous Integration and Continuous Deployment practices.

• A strong interest in AI technologies.

🏝️ Benefits

• Health insurance.

• Flexible working hours.

• Opportunities for professional development.