Senior DataOps Engineer, AWS, Security

This is a fully remote position, open to applicants in India.

📋 Description

• Design, implement, and manage scalable, highly available AWS data infrastructure.

• Collaborate with AWS services such as S3, Glue, EMR, Athena, Redshift, and Kinesis.

• Enhance infrastructure performance, reliability, and cost-effectiveness.

• Apply security best practices across AWS infrastructure and data pipelines.

• Oversee identity and access controls utilizing AWS IAM and least-privilege principles.

• Enforce encryption, secrets management, network security, and data protection measures using AWS KMS, Secrets Manager, VPC, and related services.

• Utilize AWS GuardDuty, CloudTrail, and monitoring tools to improve security visibility, auditing, and compliance.

• Construct and sustain infrastructure using Terraform and Infrastructure as Code.

• Create and manage automated CI/CD pipelines utilizing GitHub Actions, GitLab CI, or AWS CodePipeline.

• Containerize applications and oversee containerized workloads with Docker and Kubernetes.

• Automate infrastructure provisioning, configuration, deployment, and operational activities.

• Develop and maintain data workflows using Apache Airflow, Amazon MWAA, or AWS Step Functions.

• Engage with contemporary data engineering tools such as dbt.

• Implement monitoring, logging, governance, and automated compliance checks across data workflows.

• Identify and resolve infrastructure bottlenecks and data platform reliability challenges.

• Investigate and assess emerging AWS services, cloud security practices, and open-source tools.

• Create proof-of-concepts for intricate infrastructure and operational challenges.

• Propel continuous enhancements in automation, security, scalability, and operational effectiveness.

⛳️ Requirements

• 6+ years of professional experience in DataOps, DevOps, Data Engineering, or Cloud Platform Engineering.

• A minimum of 4 years of practical experience with AWS.

• Extensive experience with AWS data services, including S3, Glue, Athena, Redshift, or EMR.

• Practical experience with Terraform and Infrastructure as Code.

• Strong comprehension of AWS security, encompassing IAM, KMS, VPC networking, Secrets Manager, and security best practices.

• Experience in constructing and maintaining CI/CD pipelines with GitHub Actions, GitLab CI, or AWS CodePipeline.

• Proficient in Python and SQL.

• Familiarity with data orchestration tools like Apache Airflow, Amazon MWAA, or AWS Step Functions.

• Knowledge of Docker and Kubernetes.

• Experience in logging, monitoring, auditing, and cloud security controls.

• Experience with AWS EKS, ECS, Lambda, and Kinesis (preferred).

• Familiarity with dbt and modern data platform architectures (preferred).

• Experience implementing automated security checks and compliance controls (preferred).

• Understanding of relational and NoSQL database security (preferred).

• Experience troubleshooting complex cloud infrastructure and data pipeline challenges (preferred).

• A strong interest in exploring new AWS capabilities and modern DevSecOps practices (preferred).

• A security-first mindset with a keen focus on data privacy and risk management.

• A proactive approach towards learning, experimentation, and resolving unfamiliar issues.

• Strong analytical and troubleshooting abilities.

• An ownership-oriented approach to infrastructure reliability and automation.

• Capability to balance security, scalability, performance, and operational efficiency.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Flexible work hours and remote work options.

• Opportunities for professional development and continuous learning.

• Collaborative and innovative work environment.