Senior Systems Engineer, AWS Data Engineer

This is a fully remote position, open to applicants in Texas.

📋 Description

• Assess and propose the most effective AWS-native data storage and query architecture for XML object-store data.

• Create and establish a reporting and query layer that allows business stakeholders and non-technical users to execute relational SQL queries on healthcare data.

• Plan the migration of XML object-store data from MSSQL to the designated AWS platform.

• Specify storage formats, partitioning techniques, and data organization to enhance query performance.

• Develop and manage AWS data catalogs, schemas, and metadata oversight.

• Enhance query performance and cost efficiency through partitioning, compression, file formats, and tuning of query patterns.

• Collaborate with business stakeholders and analysts to convert reporting needs into sustainable, efficient data models and query patterns.

• Work alongside backend C#/.NET developers to ensure seamless data flows from EDI processing pipelines.

• Establish and uphold CI/CD pipelines for data infrastructure utilizing AWS-native tools.

• Implement infrastructure-as-code methodologies using AWS CDK, CloudFormation, or Terraform.

• Document architectural decisions, data flows, and data dictionaries for both technical and non-technical audiences.

⛳️ Requirements

• A bachelor's or master's degree in computer science, engineering, or a related technical field is required; equivalent practical experience is also acceptable.

• At least 8 years of experience in software or data engineering with a strong emphasis on AWS.

• Demonstrated experience in architecting and executing migrations of cloud data platforms in production settings, particularly in enterprise or healthcare sectors.

• Proven history of assessing and selecting AWS data services to fulfill business reporting and query needs.

• Experience in delivering reporting or analytics solutions tailored for non-technical business users.

• Extensive hands-on experience with AWS technologies including S3, Athena, Glue, Aurora, DynamoDB, Redshift, OpenSearch, Lambda, IAM, and CloudWatch.

• Strong SQL proficiency and capability to design relational query layers over XML and JSON data.

• Experience in parsing, querying, and transforming XML data at scale.

• Ability to analyze AWS data service trade-offs concerning cost, performance, and business requirements.

• Familiarity with Athena, QuickSight, Redshift, or similar business intelligence tools.

• Proficient with Git and GitHub, including branching strategies, pull requests, and collaborative workflows.

• Understanding of CI/CD practices and AWS-native tools such as CodePipeline, CodeBuild, and CodeDeploy.

• Experience with infrastructure as code using AWS CDK, CloudFormation, or Terraform.

• Ability to convey technical architectural decisions and trade-offs to non-technical stakeholders.

• Experience in gathering and translating business reporting requirements into technical data models.

• Comfortable navigating ambiguous architectural decisions towards resolution with minimal guidance.

• Experience with agile methodologies, including Scrum, Kanban, and JIRA.

• Strong documentation skills, including architecture diagrams, data dictionaries, and migration runbooks.

• US Citizenship is required.

• Ability to obtain and maintain a Public Trust clearance.

🏝️ Benefits

• Fully remote position.

• Equal Opportunity Employer.