AWS Data Engineer – Contract

This is a fully remote position, open to applicants in India.

📋 Description

• Design, develop, and sustain scalable data pipelines and ETL/ELT workflows on AWS.

• Modernize existing data platforms by transitioning Apache Airflow/MWAA workloads to AWS-native orchestration services.

• Migrate and enhance Amazon EMR workloads to AWS Glue.

• Create and implement scalable data lake and data warehouse solutions utilizing AWS services.

• Develop robust data models, semantic layers, and standardized KPI definitions to facilitate business analytics.

• Construct and maintain frameworks for data quality, validation, anomaly detection, and monitoring.

• Execute best practices in metadata management, data lineage, and data governance.

• Create automated deployment pipelines and infrastructure using Infrastructure as Code (IaC).

• Enhance data pipelines to optimize performance, scalability, reliability, and cost efficiency.

• Collaborate with business stakeholders to comprehend reporting needs and convert them into scalable data solutions.

• Assist with QuickSight semantic datasets, dashboard optimization, and Power BI migration projects.

• Engage in UAT, production deployments, knowledge transfer, and post-production support.

⛳️ Requirements

• Over 5 years of experience in Data Engineering.

• Proficient programming skills in Python and SQL.

• Practical experience with Apache Spark / PySpark.

• Extensive familiarity with AWS data services, including:

• AWS Glue

• Amazon S3

• Amazon Redshift

• Amazon Athena

• AWS Lambda

• AWS Step Functions

• Amazon EventBridge

• AWS IAM

• Experience in designing and implementing ETL/ELT pipelines.

• Strong understanding of data modeling, data warehousing, and data lake architecture.

• Experience with Apache Airflow or Amazon MWAA.

• Comprehensive knowledge of Data Governance, Metadata Management, Business Glossary, and Data Lineage.

• Proven experience in implementing Data Quality, Audit Logging, and Data Reconciliation frameworks.

• Familiarity with Amazon QuickSight, semantic datasets, and BI reporting.

• Proficient with Git, CI/CD, and Infrastructure as Code (Terraform or CloudFormation).

• Strong analytical, troubleshooting, and communication skills.

🏝️ Benefits

• Equal Opportunity Employer.

• Commitment to fostering a diverse and inclusive workplace.