Elasticsearch Data Engineer – Medallion Architecture

This is a fully remote position, open to applicants in India.

📋 Description

• Design, create, and oversee end-to-end data pipelines utilizing the medallion architecture—specifically the bronze, silver (base vault with DBT and orchestration tools, business vault), and gold layers.

• Ingest and process raw data using Spark and Amazon EMR to enable scalable, distributed computation.

• Develop and automate data transformations for the base vault with DBT (Data Build Tool) to efficiently standardize and model data.

⛳️ Requirements

• Minimum of 5 years of experience as an Elasticsearch Data Engineer, with expertise in the ELK (Elasticsearch, Logstash, and Kibana) stack.

• Proficiency in Java Spring Boot.

• Experience with IBM ACE Programming.

• Bachelor’s degree in Computer Science, Data Engineering (Big Data, AWS certification), Data Modeling, or a related field.

• Full fluency in English.

• Strong grasp of data modeling, governance, and best practices in contemporary data architectures.

• Exceptional analytical, problem-solving, and communication abilities.

• Extensive experience with Spark, Python, ETLs, and Amazon EMR.

• Practical experience using DBT for data transformation and modeling.

• Advanced knowledge of Amazon S3 and Apache Iceberg for data storage and management.

• Experience with Kubernetes for container orchestration.

• Familiarity with Dremio, Looker, or similar business view/semantic layer technologies.

• Intermediate knowledge of AWS Cloud, including AWS Lambda, Step Functions, IAM, SNS, API Gateway, VPC, and Transit Gateway.

• Intermediate proficiency in JSON.

• Intermediate experience with Jenkins for data pipeline management.

• Intermediate knowledge of CloudWatch.

🏝️ Benefits

• Competitive salary along with performance-based bonuses.

• Comprehensive benefits package.

• Opportunities for career development and training.

• Flexible work arrangements, including remote and/or office-based options.

• A dynamic and inclusive work culture within a globally recognized organization.

• Private health insurance.

• Pension plan.

• Paid time off.

• Training and development opportunities.