Senior Python Developer, Data Engineering

This is a fully remote position, open to applicants in Bulgaria.

📋 Description

• Design, construct, and enhance ETL/ELT pipelines that convert customer and internal data into usable datasets.

• Collaborate with Markets and Product teams to create reporting tools and dashboards that inform business strategy and address customer needs.

• Develop and sustain data lakes and feature stores utilized by the ML Engineering team to create ML solutions for subrogation.

⛳️ Requirements

• Strong expertise in Python and SQL.

• Experience with Spark or comparable distributed processing technologies.

• Extensive knowledge of AWS data services, including Glue, S3, Step Functions, Athena, EMR, DynamoDB, and SQS.

• Familiarity with data streaming technologies, such as Kafka and Spark Streaming.

• Background in data modeling, ideally within finance or insurance sectors.

• Understanding of MongoDB and document-oriented data sources.

• Experience with data lake architectures, including medallion architecture, schema management, and incremental processing.

• Proficiency in Infrastructure as Code using CloudFormation or Terraform.

• Capability to troubleshoot data quality issues across distributed systems.

• Experience with implementing data quality frameworks like Great Expectations.

• Knowledge of subrogation, claims processing, insurance, or financial technology is a plus.

🏝️ Benefits

• GDPR-compliant handling of candidate information.

• Secure storage and management of candidate information.

• Privacy protection throughout the recruitment process.