IT Platform Engineer, Data Lake, AI Gateway

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop and sustain the AWS-native lakehouse architecture utilizing Python, Glue, Athena, S3, and Iceberg medallion-style layering.

• Manage infrastructure via code with version control, thorough reviews, and repeatable deployment processes.

• Construct and oversee dependable data pipelines that include monitoring and failure management.

• Operate and provide support for the internal AI platform, which encompasses the LLM gateway, Bedrock, custom utilities, and zero-trust access protocols.

• Implement security and access standards across data and model layers, focusing on IAM scoping, network controls, and secrets management.

• Collaborate with IT, Security, and Engineering teams to ensure platform alignment with overarching operational standards.

⛳️ Requirements

• Extensive experience with infrastructure-as-code, particularly using Terraform or a similar tool as a key part of your workflow.

• Strong understanding of AWS fundamentals, including IAM, networking (VPC and PrivateLink), and S3.

• Expertise in Python for developing data pipelines, automation, and tool creation.

• Ability to independently manage production infrastructure as an individual contributor.

• Experience with Agile methodologies for work management.

• Familiarity with LLM gateways, API proxies, or Bedrock/model-serving infrastructure is highly advantageous.

• In-depth knowledge of data engineering, specifically in pipeline design, Glue/Athena, and lakehouse architectures is a significant plus.

• Capacity to work autonomously across different time zones while maintaining CST hours for effective collaboration.

🏝️ Benefits

• Remote work opportunities.

• Flexibility to work independently across various time zones.

• Collaborative environment during CST hours.